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Abstract 

It is an increasingly important problem to study conditions on the structure of a 
network that guarantee a given behavior for its underlying dynamical system. In this 
paper we report that a Boolean network may fall within the chaotic regime, even under 
the simultaneous assumption of several conditions which in randomized studies have 
been separately shown to correlate with ordered behavior. These properties include 
using at most two inputs for every variable, using biased and canalyzing regulatory 
functions, and restricting the number of negative feedback loops. 

We also prove for n-dimensional Boolean networks that if in addition the number of 
outputs for each variable is bounded and there exist periodic orbits of length c" for c 
sufficiently close to 2, any network with these properties must have a large proportion 
of variables that simply copy previous values of other variables. Such systems share a 
structural similarity to a relatively small Turing machine acting on one or several tapes. 

The concept of a Boolean network was originally proposed in the late 1960's by Stuart 
Kauffman to model gene regulatory behavior at the cell level |181I19| . This type of modeling 
can sometimes capture the general dynamics of continuous systems in a simplified frame- 
work without the choice of specific nonlinearities or parameter values; see for instance [1]. 
Boolean networks are used in several other disciplines such as electrical engineering, com- 
puter science, and control theory, and analogous definitions are known under various names 
such as sequential dynamical systems [23] or Boolean difference equations [8]. 

In studying the dynamics of Boolean networks, Kauffman distinguishes an ordered regime 
and a chaotic regime and argues that the dynamics of actual gene regulatory networks 
should be close to the boundary of these two regimes (see [20] for a review). Each regime 
is characterized by several hallmark properties that usually, but not always, are present 
simultaneously. In this paper we focus on one such property, the existence of exponentially 
long orbits, although two additional such properties will be briefly considered as well. 

Since the state space of an n-dimensional Boolean system is finite, each trajectory must 
eventually reach a periodic orbit of length < 2" or a fixed point. The ordered regime is 
characterized by relatively short orbits whose length scales like a low-degree polynomial 
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in n. In contrast, orbits whose length scales exponentially in n are a hallmark of the chaotic 
regime. We will call an n-dimensional Boolean network c-chaotic if it has an orbit of length 
> c", for 1 < c < 2. 

An n-dimensional Boolean dynamical system or Boolean network consists of n variables 
si,...,Sn, each of which can have value or 1 at any given time step t. The updates 
for each variable are calculated by Si{t + 1) = gi{si{t), . . . ,Sn{t)), where gi is called the 
i-th regulatory function of the system (taking our motivation from Boolean models of gene 
regulatory networks). In the study of random Boolean networks (RBNs), these regulatory 
functions are randomly and independently drawn from a specified distribution, and the 
dynamics of the resulting network is simulated for a sample of initial states. 

Much attention in empirical studies has focused on studying which properties of the 
regulatory functions correlate with dynamics within the ordered regime. Already in his 
1969 papers |18l 119] . Kauffman focused his attention on Boolean networks where each gi 
depends only on a bounded number of inputs, regardless of the dimension of the network. 
This corresponds to findings about actual gene regulatory networks which show that most 
genes are directly regulated by a small number of proteins in a scale-free manner [U 131] . 
We also note that the scale-free distribution implies that in some large subnetworks each 
variable has a bounded number of outputs, i.e., acts as input only for a bounded number of 
variables. 

A so-called NK-network is an RBN of dimension N obtained by randomly choosing a set 
of K inputs for each regulatory function, and then choosing g^ randomly from the uniform 
distribution of all Boolean functions on this set of inputs. The choices for different i are 
independent. Since not all Boolean functions on K variables depend on all inputs, one 
can consider an NK-network as a random network where each regulatory function takes at 
most K inputs. 

For K = 2 the dynamics of A^i^-networks tends to be in the ordered regime; in particular, 
the median length of orbits is on the order of \/iV. In contrast, when K > 2, the dynamics 
tends to be chaotic [20] . 

However, several additional restrictions on the g^'s still tend to result in RBNs with 
ordered dynamics, even for large average number of inputs. 

The bias A of a Boolean function is the fraction of input vectors for which the function 
outputs 1. Studies of RBNs in which each gi has bias A close to or 1 show that the 
dynamics tends to be in the ordered regime even if the ^j's have a relatively large numbers 
of inputs PEg. 

A Boolean function g^ that depends on variables xi, . . . ,xi is canalyzing if there exist 
one input variable Xc and Boolean values u, v such that gi{xi, . . . , xi) = v whenever Xc = u. 
A stronger property is the notion of a nested canalyzing function. Empirically characterized 
Boolean regulatory functions tend to be nested canalyzing [13]. Since for Boolean functions 
with at most two inputs the two notions coincide, we will not define this stronger property 
here. RBNs in which all regulatory functions are nested canalyzing functions were found 
to have dynamics in the ordered regime, even though individual giS may have numerous 
inputs [21] . 
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Finally, RBNs with no or only few negative feedback loops tend not to reach long orbits, 
even when the gj's are not restricted to those with the properties listed above [28| . This 
behavior can be compared to that of continuous systems with no negative feedback, which 
are well known to converge generically towards an equilibrium ( [26] and see the next section) . 

Simulation studies of RBNs can only demonstrate that exponentially long orbits are 
not reached from the initial conditions that are sampled. Our research was guided by the 
following question: under what conditions for the network can the absence of c-chaos for c 
sufficiently close to 2 be rigorously proved? In particular, we were interested in whether a 
combination of the conditions that were known empirically to generate RBNs with ordered 
dynamics would preclude the existence of very long orbits. In this paper we report that 
even when all these assumptions are made simultaneously, for every positive c < 2 one can 
construct examples of Boolean networks whose dynamics exhibits c-chaos. This is true even 
when the number of outputs per variable is limited to 2. However, the situation changes 
somewhat if we assume in addition to the latter that all, or a specified proportion of the 
regulatory functions take exactly two inputs: for such systems it is possible to prove the 
absence of c-chaos for some c < 2. 

Boolean systems in which most regulatory functions take only one input share a struc- 
tural stability with a small Turing machine that acts on one or several tapes. We conclude 
that this Turing-like structure is the only possibility for building some types of extremely 
chaotic dynamics into Boolean systems from a certain class. 

1 Major Results 

We define a {b, r)-Boolean system as a system in which each regulatory function has 
at most r inputs, and each variable has at most b outputs. If r = 2, we call the system 
quadratic; a (2, 2)-system is called bi-quadratic. A regulatory function that depends on only 
one variable is called monic; a non-monic quadratic regulatory function is called strictly 
quadratic. A Boolean network with only quadratic regulatory function will be called a 
strictly quadratic network; a strictly quadratic bi-quadratic network will be called strictly 
bi-quadratic, even if some variables have fewer than two outputs. 

In the context of continuous dynamical systems, a system without negative feedback 
loops is called monotone [2 [26]. Special cases of monotone systems are cooperative systems 
in which there are no direct inhibitory interactions between any two variables. Monotone 
and cooperative systems have been used as a modeling tool for gene regulatory systems, e.g. 
in [251 [3l [7]. While negative feedback tends to generate oscillatory dynamics, the assumption 
of monotonicity in continuous systems ensures, under mild additional assumptions, that a 
generic solution of a monotone dynamical system must converge towards an equilibrium. 
In contrast, cooperative Boolean systems can still have exponentially long orbits (see e.g. 

[27], m)- 

Cooperative Boolean systems have regulatory functions that can be expressed using 
only AND and OR gates, i.e., with no use of negations. This can be seen by considering 
the disjunctive normal form of the Boolean maps. In particular, the only non-constant 
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regulatory functions allowed in quadratic cooperative Boolean systems must have the form 
dk = A Sjf^, Qk = Sif^ V Sji^, or gk = Si^. Note that if gk is constant then we get 
identical dynamics along attractors if we replace it with the monic function g^ = s^. Since 
transient states are irrelevant for our results, we will without loss of generality assume that 
all regulatory functions are non-constant. 

All regulatory functions that are allowed in quadratic cooperative Boolean systems are 
canalyzing, and the two permissible strictly quadratic regulatory functions have bias A = 
0.25 and A = 0.75 respectively. Our first theorem shows that even if all regulatory functions 
have at most two inputs, are strongly biased and canalyzing, and negative feedback is totally 
absent, the system may still have exponentially long periodic orbits. 

Theorem 1 Let c, ci he constants with 1 < c < 2 and 1 < ci < 10^/^. Then for all suffi- 
ciently large n there exist n- dimensional cooperative Boolean networks that are, respectively: 

(i) bi-quadratic and c-chaotic, 

(ii) strictly quadratic and c-chaotic, 
(Hi) strictly bi-quadratic and ci-chaotic. 

Moreover, as we we will show in Theorem H] of Appendix A, the construction in point (i) 
can be done in such a way that 

1. the values of most of the variables of the system continue to alternate between and 
1 over time, for most initial conditions, and 

2. with probability arbitrarily close to one, changing the value of a randomly chosen 
variable in almost every initial condition sends the trajectory of the system into a 
different basin of attraction. 

We will consider these properties in more detail in the Discussion Section below. This con- 
firms that the system displays several hallmarks of extremely chaotic behavior as generally 
defined in the literature. 

Our second major result shows that it is not possible, for c less than but arbitrarily close 
to 2, to construct n-dimensional bi-quadratic cooperative Boolean networks with c-chaotic 
dynamics in such a way that all or even a given proportion of regulatory functions are strictly 
quadratic. This result has an interesting interpretation from the point of view of theoretical 
computer science. Consider a sequence of variables ki, . . . ,km such that gki+i = for all 
i £ {1, . . . ,m — 1}. The dynamics of the system on these variables is analogous to that 
of a memory tape of a Turing machine that advances by one position at each time step. 
A new value may be written to position ki at each time step, and this value may be read 
i time steps later by some regulatory function off position fc^+i. If km = ^i, the tape is 
'read-only,' and a constant regulatory function can be considered a special case of a 'read- 
only' tape of length one. A tape could split into two or more branches, but the values on 
these branches would eventually be only copies of each other. Thus any cooperative system 
that contains monic regulatory functions can be conceptualized as a Turing machine whose 
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internal states correspond to all non-monic variables and that acts on one or more tapes, 
possibly branching or of varying lengths. Let us call an n-dimensional Boolean system 
an {M,n) -Turing system if at least n — M of the regulatory functions are monic. While 
every n-dimensional Boolean system is an (re, n)-Turing system in the sense of the above 
definition, if M < n, the roles of the 'machine' and the 'tapes' can be neatly separated. If 
also monic regulatory functions gk = ^Si^. may occur in the system, then the connection 
with the Turing machine metaphor becomes more tenuous, but for convenience we will still 
use this terminology even if the system is not assumed cooperative. 

The idea of the proof of Theorem (Hi) sketched below is based on the metaphor of a 
Turing machine. The systems constructed in this proof are (M(n), n)-Turing systems such 
that lim^^oo ^^^^^^ = 0. While the metaphor of a Turing machine acting on one or several 
tapes readily comes to mind as a mechanism for constructing counterexamples, it is far 
from obvious whether totally different systems with analogous properties might exist. But 
Theorem [2] below implies that for c sufficiently close to 2 our construction is in some sense 
the only possibility to build c-chaos into certain systems. 

We say that a Boolean system (11, g) is e-hiased if every non-monic regulatory function 
has bias A with |A — 0.5| > e. In particular, quadratic Boolean systems are 0.25-biased. 
Cooperative Boolean systems with regulatory functions that can take three or more inputs 
need not be e-biased for any e > 0. For example, A = 0.5 for the Boolean function with 
three input variables that takes the value 1 iff the majority of input variables are equal to 1. 

Theorem 2 Let e, a > and let b, r he positive integers. Then there exists a positive 
constant c(e, a, b,r) < 2 such that for every c > c{e, a, b, r) and sufficiently large n, every 
c-chaotic, n-dimensional e-biased {b,r)-Boolean system is an {an,n)-Turing system. 

A canalyzing Boolean function has bias A = 0.5 iff it is monic. Since there are only 
finitely many Boolean functions on any fixed number of inputs, the conclusion of Theorem [2] 
will hold in particular for all (b, r)-Boolean systems in which all regulatory functions are 
canalyzing. 

Theorems [T] and [2] combined show that while the assumptions of canalyzing regulatory 
functions and absence of negative feedback do not impose a nontrivial bound on the lengths 
of orbits in (6, r)-Boolean systems, the assumption that all or sufficiently many regulatory 
functions be sufficiently biased does impose such bounds. 

2 Sketches of the Proofs 

Here we sketch the proofs of our main theorems. Detailed proofs were first reported in |10j 
and ^7\; improved versions of these proofs are given in Appendices A and B. 

2.1 Proof of Theorem [1] 

The idea of Theorem [T]^i) is based on thinking of variables si, . . . ,sn as the internal states 
of a Turing machine that writes successive binary codes of integers 0, . . . , 2^ - 1 to the 
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variables that are organized in a long circular tape. A straightforward implementation 
would have Si{t) := Sj+i(i — 1) for i = 1, . . . , N — 1 and an internal variable mode such that 
if mode = rotate, then s^it) ■= si{t — 1), and if mode = switch, then SN{t) := -^si(t — 1). 

For instance, if = 7 and {sn, ■ ■ ■ , si) = (0 1 1 1 1) at t = 0, then letting 
mode = rotate for three time steps and mode = switch for another four, one reaches the 
new state (sat, . . . , si) = (0 1 1 0) at i = A, which corresponds to adding one to the 
binary code for t = 0. After every A^ time steps one necessarily reaches the binary code of 
the successor (modulo 2-^) of the previously coded integer, which guarantees for the overall 
system an orbit of length at least 2^ . 

The major problem with this implementation is that it involves negation and thus is 
non-cooperative. Our construction overcomes this obstacle in the following way. Instead 
of the binary digits Sj, let each of the variables Si, ... , Sk be a binary sequence of length 
L, and let A = KL. Importantly, the values of Si are not arbitrary but chosen from 
the image of an injective function F : {0, ...,2^ — 1} ^ 2^^'''^^, i.e. they are thought 
of as coding integers from to 2^ — 1. Additionally, the values of F(x) are required to 
have exactly L/2 nonzero entries. Such a function F exists for suitable choices of i and 
L. Again, let Si{t) := S'i+i(i — 1) for i = 1, . . . , A' — 1. Similarly, if mode = rotate, then 
Sxit) := Si{t — 1). If mode = switch, then Sxit) is the code for the integer F~^(S'i) -|- 1, 
where addition is defined modulo 2^. The variable mode will be coded by a binary string of 
length 2, with (0, 1) standing for rotate and (1,0) standing for switch. 

Now consider the Boolean vector function that takes as inputs the variables Si{t — 1) 
and modeit — 1) and outputs Sxit) and mode{t) — this function constitutes the computing 
core of the system, and one can refer to it as the 'Turing machine' M within the Boolean 
network. The coding function F is defined in such a way that the core function in M 
can be implemented without the use of negation. Allowing for some delay in the output, 
such a machine in turn can be coded by one that uses only binary AND- and OR- gates. 
The resulting delay poses another technical problem since mode{t) depends on mode{t — 1); 
Lemma [6] of Appendix A gives our solution of this problem. At every time t we use up one 
of the K states Si,. . . , Sk to mark the beginning of the encoded information. Thus we 
obtain a bi-quadratic cooperative Boolean system with orbits of length at least 2^^^~^^ = 
2t{N-L)/L ^ and the number of internal variables of the Turing machine M is a number T{L) 
that depends only on L. Figure [1] illustrates our construction. The 'Turing machine' M 
corresponds to the union of the subnetworks B and D of Figure [3] of Appendix A. 

For a given 1 < c < 2 we can find positive integers £ < L such that {^^2} > 2^ > and 
2iiN-L)/L y ^ The total number of variables in the system is given by n = A -|- T{L), 
and it follows that for sufficiently large n, we can choose i, L, N so that the system we 
constructed will contain an orbit of length > c", as stated in Theorem [T]^i) . 

For the proof of part (ii) let (S,/) be a quadratic cooperative Boolean system of di- 
mension n — 2 that contains an orbit of length c". Let 11 = {0, 1}", let = fi^ whenever 
k < n — 1 and fk is strictly quadratic, let gk = Sj^. A s„ whenever k < n and fk = Si^, , and let 
gn-i = Qn = Sn-iASn- Then (n, (7) is cooperative, quadratic, and has only strictly quadratic 
regulatory functions. For a state s G S define a state s* G 11 by s* = (si, . . . , Sn-2-, 1, !)• 
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Figure 1: Architecture of the Boolean network constructed in this proof. 

Then the orbit of s* in (IT, g) has the same length as the orbit of s in (S, /). 
The proof of part (iii) is given in Appendix A. 

2.2 Proof of Theorem [2] 

The proof is based on the observation that very large subsets of the state space of Boolean 
systems must be balanced in the following sense. Let S = {s^ : ^ £ £} be a subset of the 
state space 11 = {0, 1}". Consider an r-element subset / = {ii, . . . , v} of {1, . . . , n} with 
ii < ■ ■ ■ < ir, and let o" : {1, . . . , r} ^ {0, 1}. Define a ratio S,J{S) by 

^^^^^ = \c\ • 

If S is randomly chosen, then £,j{S) will be close to 2~^. Intuitively, a balanced set S 
is one in which only few of the ratios differ substantially from 2~I^L More precisely, if 
7 > 0, then we will say that S is P-'j-r -balanced if for every family P of pairwise disjoint 
subsets / of {1, . . . , n} with | |J P| > /3n and 1 < |/| < r for each I £ P there exists I £ P 
such that \S,j{S) - 2-l^l| < 7 for all relevant a. 

In the first part of the proof of Theorem [2] we show that for any given positive integer 
r, and /3, 7 > with 7 < 2~^ there exists a constant c < 2 such that for sufficiently large n, 
every subset S of {0, 1}" of size > c" is /?-7-r-balanced. The proof of this fact uses the 
probabilistic method. We fix c < 2 and derive an upper bound for the probability that a 
randomly chosen subset of size > c" of {0, 1}" is not /3-7-r-balanced. For c sufficiently close 
to 2, this probability will be less than j . But if there exists any unbalanced subset of 

{0, !}"■ of this size, then it would be picked with probability at least ^, which leads to 
a contradiction. 

Now consider an e-biased, n-dimensional (6, r)-Boolean system with a /?-7-r-balanced 
orbit S. For suitable choices of /?, 7, there will be a subset S* of S with |5*|/|5| ~ 1 and a 
set J C {1, . . . , n} of size \ J\ < (r + l)/3n so that £,j{S*) = 2~l^l for all relevant a whenever 
/ is the set of inputs of a variable k ^ J and / is disjoint from J. Let khe a variable outside 
of J whose regulatory function is biased; wlog assume A > 0.5 + e. If the set of inputs / of 
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gk is disjoint from J, then 



^1^^^ ^ \{i:/GS* ksi = l}\ ^ (0.5 + 6)15-- 



and by the choice of J we get a contradiction with the assumption that 5 was /3-7-r-balanced 
and thus in particular /3-7-1-balanced. 



3 Summary and Discussion 

Exponentially long orbits of Boolean systems are a hallmark of the chaotic regime. In 
empirical studies of RBNs very long orbits tend not to be reached when the number of 
inputs for each regulatory function is bounded by 2 [20], when the regulatory functions are 
strongly biased [9l [32] , when all regulatory functions are nested canalyzing functions [21] , 
or when there are few negative feedback loops |28j . 

Theorem [ll^ii) shows that even the conjunction of these four conditions is not sufficient 
to prove a nontrivial upper bound on the lengths of possible orbits. If in addition an upper 
bound on the number of outputs per variable is assumed, then nontrivial upper bounds can 
be derived (Theorem [2]). Such bounds can be derived assuming only restrictions on the 
number of inputs and outputs per variable and that a given fraction of regulatory functions 
is sufficiently biased. Even with these additional assumptions, exponentially long orbits 
may exist (Theorem [Ij^iii)). Without assumptions on the fraction of sufficiently biased 
regulatory functions, no nontrivial upper bound on the lengths of orbits can be derived for 
bi-quadratic cooperative Boolean systems (Theorem [Tj^i)). For c sufficiently close to 2, all 
n-dimensional bi-quadratic Boolean systems with orbits of length c" must be structurally 
similar to a Turing machine acting on one or several tapes (Theorem [2|) . 

Theorem [2] has yet another alternative interpretation. Variables with monic regulatory 
functions just record the values of other variables (in some cases their negations, if cooper- 
ativity is not assumed) at a certain time in the past. Thus if we allow time delays in the 
definitions of regulatory functions, we can remove all but the first variable on each 'tape' 
and define a Boolean delay system on the remaining variables that will have equivalent 
dynamics, in particular, that will have orbits of the same length as the original system. 
Gene regulation always involves a delay between gene transcription and the time when 
the translated gene product becomes available as a regulator, such as a transcription fac- 
tor. Boolean delay systems with internal variables that record the state of other variables 
were proposed as models of gene regulatory networks in the framework of 'kinetic logic' by 
R. Thomas [291 130] . Internal variables are not needed in the framework of continuous-time 
Boolean delay systems as studied in [8l [12] . See [13] for a comprehensive survey and addi- 
tional references. Our (M, n)-Turing systems can be conceptualized in this framework as 
continuous-time Boolean delay systems with M + m Boolean variables and rational delays, 
where m is the number of read-only tapes (see Appendix F). Thus Theorem [2] implies that 
for any given for a,e > and positive integers b,r there exists a positive constant c < 2 
such that for sufficiently large n, every n-dimensional e-biased {b, r)-Boolean system with 
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an orbit of length at least c"" is equivalent to a Boolean delay system with rational delays 
and at most an Boolean variables. 

For given e, a, b, r let c{e, a, b, r) denote the largest constant c for which the conclusion 
of Theorem [2] holds. For example, if a bi-quadratic cooperative system of sufficiently large 
dimension n has an orbit of length > 0(0.25,0.1,2,2)", then at least 90% of all regulatory 
functions must be monic; if such a system has an orbit of length > c(0.25, 1, 2, 2)", then at 
least some of the regulatory functions must be monic. Our proof of Theorem [2] gives upper 
bounds for c(e, a,6, r). Numerical explorations show that for small 6, r and relevant e the 
dependence on a of this upper bound is almost perfectly linear (see Figure|4]of Appendix C). 
In particular, for the case of bi-quadratic cooperative systems, when e = 0.25 and b = r = 2, 
we get the following linear approximation of the upper bound: c(0.25, a, 2, 2) < 2 — 0.0041a. 
For a sufficiently close to 1, we were able to improve this upper bound to c(0.25, a, 2, 2) < 
10(2^°)/4 (Corollarvll9lof Appendix C). On the other hand, our proof of Theorem [T]^iii) gives 
the lower bound 10^/42^-" < c(0.25, a, 2, 2) (Proposition [U] of Appendix A). For a = 1 
the upper and lower bounds coincide, and we conclude that c(0.25, 1, 2, 2) = 10^/^ w 1.7783 
(Theorem [3] of Appendix C). Unfortunately, the proof of the latter two results does not 
easily generalize to cases when 6 7^ 2 or r 7^ 2. It will be an interesting direction for future 
research to find improved estimates of c(e, a, b, r). 

Let us conclude with a brief discussion of two other hallmarks of the chaotic regime. 
In a typical network with ordered dynamics, along the attractors reached from most initial 
states, a large proportion of the variables will never change their values; such variables 
are usually called frozen |20j . Let us consider a corresponding hallmark for highly chaotic 
systems and call a Boolean network p-fluid if for a randomly chosen initial state with 
probability at least p the network will reach an attractor along which a proportion of at 
most 1 — p of the variables are frozen. 

In the ordered regime, most single-bit flips in most initial conditions will leave the 
trajectory in the same basin of attraction. This property is called high homeostatic stability 
in |20j . In contrast, chaotic systems are characterized by low homeostatic stability. Let 
us call a Boolean system p-unstable if a random bit flip in a randomly chosen initial state 
with probability at least p moves the trajectory into the basin of attraction of a different 
attractor. 

For any given positive probability p < 1 and sufficiently large n, one can construct 
systems as in Theorem [TJi) that are p-fluid and p-unstable (Theorem |4] Appendix D). Thus, 
the systems as in part (i) of Theorem [1] can in a sense be maximally chaotic according to 
all three criteria considered here. 

It is also quite easy to construct strictly bi-quadratic, cooperative 1-unstable Boolean 
networks of dimension 2n for any n (see Proposition 12 1 1 of Appendix E). However, we were 
able to prove that sufficiently high-dimensional cooperative, strictly quadratic Boolean sys- 
tems cannot, for example, be simultaneously 0.9-unstable and 1.85-chaotic (see Theorem [5] 
of Appendix E for a more general result). This is yet another indication that extreme chaos 
is possible only in Turing systems. The result also shows that different hallmarks of the 
chaotic regime show quite different sensitivity to the conditions on the network architecture 
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that were considered in this paper. 
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4 Appendix A: Proof of Theorem [1] 

A proof of Theorem [1] was reported in [10]. Here we include a somewhat improved version 
of this proof. 

We associate a directed graph D with vertex set [n] := {1, . . . , n} with an ?i-dimensional 
Boolean system (11, as follows. A pair <i^j > is in the arc set of D iff there exist states 
s, r G n such that Sj < and Sk = for aWk ^ i with the property that {g{si))j < {g{ri))j. 
Note that the system is bi-quadratic if both the indegree and the outdegree of all vertices 
in D is at most 2. 

We will construct the systems in the proof of part (i) of Theorem [T] in such a way that 
the associated digraph D is strongly connected. This is of interest in connection with the 
results in [16]. There, we define a local version Dg of D for every state s as follows: A 
pair < i,j > is in the arc set of Dg iff there exist a state r S 11 such that either Sj < rj 
while Sk = Vk for all k i, and we have {g{si))j < {g{ri))j] or < Sj while Sk = for all 
k ^ i, and we have {g{ri))j < {g{si))j. It is shown that if X is an orbit of an n-dimensional 
cooperative Boolean system such that Dg is strongly connected for every s € X, then 
\X\ < n (Theorem 25 of [16]). The construction presented here shows that the analogous 
global property of the digraph D does not impose any nontrivial bounds on the lenghts of 
orbits, not even for bi-quadratic cooperative systems. 

4.1 Proof of part (i) 

The proof uses a construction similar to a small Turing machine operating on several long 
circular tapes. We will first introduce the main idea of the construction, but without 
requiring the system to be cooperative and bi-quadratic. Subsequently we will show how 
to modify the construction so that the network will also be cooperative, bi-quadratic and 
will have a strongly connected digraph. 

4.1.1 A Simple Counting Model 

In this subsection we consider a conceptual model of a (not necessarily bi-quadratic or 
cooperative) Boolean network with orbits of length 2^, for arbitrary iV > 0. We also 
discuss the problems that are involved in constructing such a network under the restrictions 
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of Theorem [T]^i) . Consider a Boolean system with states (si,...,SAr) and the dynamics 
defined by 



Si{t):=Si+i{t-l), i = l,...,iV-l 
SN{t) '■= 7('5i(i — l),mode{t — 1)). 



(1) 



One can think of 7 as implemented by a Turing machine operating on variables numbered 
i = 1, . . . ,N whose values are written on a circular tape. The variable mode can have one 
of two possible values for every t, namely mode = rotate, and mode = switch, and the 
function 7 is defined by 



Thus while mode{t) = rotate, iterating this machine will cyclically rotate the values of 
si, . . . , Sat. Whenever mode = switch, the machine also will rotate the variable values, but 
it will invert them at the site sn- 

Now let us define the value of the variable mode, in such a way that this machine 
behaves like a counter in base two. Let us require that mode{t) = switch at the times 
t = 0,N, 2N, 3N, .... A possible mechanism for ensuring this property will be discussed 
when we present our modified construction. For all other times t, define 



Thus the model turns into switch mode exactly at the times t = 0,N, 2N, . . ., and it 
only returns back to rotate mode after si(ti) = for some ti > t. The following lemma 
shows in what way this machine is a counter: if the states of the system encode numbers 
in binary format appropriately, then iterations are equivalent to the addition of one unit 
modulo 2^. 

Lemma 1 Given any state s of the model, define a{s) := 512*^ + 522"*^ + . . . + sn2^~^ ■ Then 
a{s{N)) = a{s{0)) + 1 mod 2^. 

Proof: Consider an initial state s(0) and let j >0 he such that Si{r]) = 1, for I < r] < j < 
N, and Sj+i(0) = 0. Note that a{s{0)) < 2^ — 1 in this case. We have mode{0) = switch 
by the definition above By ([1]), = 1 for < t] < j — 1 and = 0. Therefore 

mode(r]) = switch, for I < rj < j, and mode{j + 1) = . . . = mode{N — 1) = rotate. At time 
t = N, the variable values have completed a full rotation and returned to their starting 
points, except that s,j = for 1 < r/ < j, s^+i = 1, and Sj+2, ■ ■ ■ ,sn are unchanged. Clearly 
a{s{N)) = a{s{0)) + 1 in this case. 

It remains to show the result for the case j = N, i.e. Sj(0) = 1, for every i = 1, . . . ,N. 
In that case mode{0) = mode{l) = . . . = mode{N — 1) = switch by ([I]) and ([3]). In this way 
every value of the system is inverted at si from 1 to 0, so that Si{N) = for i = 1 ... A. 
Therefore a(s(A)) = = a(0) + 1 mod 2^. □ 



■j{x, rotate) = x. 
■j{x, switch) = 1 



X. 



(2) 




mode{t — 1), if si{t — 1) = 1, 
rotate, if si{t — 1) = 0. 



(3) 
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Corollary 2 The network given by equations (OP, contains an orbit of length at 

least 2^. 

Proof: Since the variable mode is reset to switch for t = 0, N,2N, . . Lemma [1] applies 
at each of these time points. Therefore one can start with s(0) = 0, and apply Lemma [1] 
successively to reach states s(0), s{N), s{2N), . . . , s{{2^ — 1)N), which are all different from 
each other. □ 

Importantly, the function 7 negates the values of the input x in switching mode. This 
appears to be an essential non-cooperative component (or negative feedback) of this system. 
Nevertheless, it is shown below that in fact one can rewrite our system in such a way that 
the resulting system is cooperative. 

4.1.2 A Generalized Counter 

Before proceeding with the proof of the main result, consider the following generalization 
of the simple counter above. Instead of individual Boolean values, each variable Sj is now 
considered to be a vector with £ > 1 Boolean entries. Si = (sf , . . . , sj). We will treat Si as 
a binary code for a nonnegative integer < 2^. At each time t, the system continues to be in 
one of two modes mode{t) = switch or mode(t) = rotate, but the function 7 is now replaced 
with a vector function G which we describe in the next paragraph. 

As before, when mode = rotate we let G{x,mode) := x. When mode = switch, and 
given S = {s^, s^~^ . . . ,s^) / (1, . . . , 1), let j be such that s^ = 1 foi 1 < i] < j < I and 
gi+i = 0. Define R by letting := for 1 < f] < j, letting r^^^ := 1, and r'' := s^ for 
j + l<V<i- Set G{S, switch) := R. If 5 = (1, . . . , 1), set G{S, switch) := (0, . . . , 0). In 
other words, the function G{S, switch) is defined as the addition of 1 to the vector S, in 
base 2 and modulo 2K 

We define the generalized system 

:=5,+i(t-l), i = l,...,N-l, 
SN{t) := G{Si{t - l),mode{t - 1)), 

where G is defined as above. The variable mode{t) has the value switch for t 
and for other values of t: 

modeit):=i^''<'-'^^ if 5,(t - 1) = (1, . . . , 1), 
[ rotate, otherwise. 

One can naturally think of this system as a Turing machine that computes G and 
operates on i simultaneously advancing circular tapes, with Si representing the i-th cross- 
section of these tapes. The machine reads the value of Si and writes to Sn. 

Lemma 3 The network defined by equations contains an orbit of length at least 

2m ^ 



(4) 

= 0, N, 2N,... 
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Proof: For S = . . . , s^) G {0, 1}', define (3{S) := 5^2° + s^2^ + ... + 8^2^'^ . Note that 
j3{G{x, switch)) = f3{x) + 1 mod 2^. We follow an argument very analogous to Lemma[T]and 
Corollary [51 Let a{S) := /3(5i)(2^)0 + P{S2){2^)^ + ... + P{Sn){2^)^-^ . Thus the vector 
. . . ,/3{S]\f)) can be regarded as the representation of a{s) in base 2K 

As in the proof of Lemma [TJ consider an initial state S{0), and let j > be such that 
5^(0) = (1,... ,1), for 1 < r/ < J < N, and 5^+1(0) / (1,...,1). As before, we have 
mode{r]) = switch for < i] < j , and mode{j + 1) = . . . = mode{N — 1) = rotate. At time 
t = N we have 5^ = (0, . . . , 0) for 1 < < j, as well as P{Sj+i) = /3{Sj+i{Q)) + 1, and 
■ ■ ■ , Sn are unchanged from t = 0. Clearly a{S{N)) = a{S{0)) + 1. 

In the case that ^^(O) = (1, . . . , 1) for every i = 1, . . . ,N, it follows as before that 
mode{0) = mode{l) = ... = mode{N — 1) = switch. Therefore Si{N) = (0, ...,0) for 
i = l...iV, and a{S{N)) = 0. 

Repeating this process for ^(O) = and t = N, 2N, . . . , as in Corollary [21 one finds 
states S of the system such that a{S) = 1, 2, . . ., and which are therefore pairwise different. 
When Si = (1, . . . , 1) for all i, that is, when a{S{t)) = (2^)^ — 1, this process reverts to 
a{S{t + N)) = 0. □ 

4.1.3 A Cooperative Counter 

In this subsection we carry out a construction which is analogous to that in Subsection 14. l.l| 
but in which the underlying Boolean network is cooperative, bi-quadratic, and has a strongly 
connected digraph. We will need to define some auxiliary Boolean networks with designated 
input and output variables. 

Throughout this section let L > be an arbitrary even number, and consider the 
set A := {{ai, . . . a^) S {0, 1}^ | ai + . . . + = L/2}. Define the special sequences 
START = (1, . . . , 1, 0, . . . , 0), i.e., L/2 ones followed by L/2 zeros, and similarly ACTIVE = 
(0, . . . , 0, 1, . . . , 1). The idea of the proof is to code arbitrary binary vectors of length i as 
elements of A. Similarly, the internal variable mode will be encoded by a Boolean vector d 
of length 2, with (1, 0) standing for switch and (0, 1) standing for rotate. This will allow us 
to implement the dynamics described in the previous subsection in a cooperative system. 

Lemma 4 Let g : A ^ A be an arbitrary function. There exists a Boolean network B with 
input vectors a = (ai, . . . ,0^), d = {di,d2), and output vector c = (ci, . . . ,cl), such that 
for some fixed m > the following equation holds for every t and a{t) £ A, regardless of 
the initial state of B: 



Furthermore, the network B is cooperative, every node of its associated digraph has in- 
and outdegree of at most 2, and the indegree (outdegree) of every designated input (output) 
variable is 0. 




(6) 
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Proof: Define the set A := Ax{{0, 1), (1,0)}, and the function h: Ahy h{a, (1,0)) := 
g{a), h{a, (0, 1)) := a, for arbitrary a ^ A. Since A is an unordered set in the coordinatewise 
partial order of Boolean vectors, h can be extended to a cooperative function h : {0, l}^"*"^ — > 
{0, 1}^ [IS]. The result wih follow fr om building a suitable Boolean network that computes 
the function h. 

Consider a fixed component hi : {0, 1}^"''^ {0, 1} of h. By the cooperativity of 
this function, one can write it in the normal form /ij(yi, . . . -,1)1+2) = ^U^i' ■ ■ ■ iyL+2) V 
... V (yi, . . . , ?/L-|_2), where each is the conjunction of a number of variables, i.e., 
^*(yi, . . . , yL+2) = Uaii A ... A Uoji- This suggests a way of computing hi: define Boolean 
variables jpj{t) := ^'*(y(t - 1)), and then let hi{t) := ip\{t - I) y . . . y ipl^{t - 1) . Repeating 
this procedure for all components of h yields a Boolean network which computes /i in m = 2 
steps, and which is cooperative and has indegree (outdegree) for every input (output). 

In order to satisfy the condition that every node have in- and outdegree of at most 2, we 
need to modify this construction by introducing additional variables. First, note that the 
outdegree of every input yi can be very large. One can define two additional variables which 
simply copy the value of yi{t), then four variables that copy the value of the previous two, 
etc. This procedure is repeated for each yi so that at least as many copies of each variable 
are present as appear in the expressions of all ipj. A similar cascade can be used to define 

each ipj and hi so that each indegree is at most two. If tpj = ya^ A ya2 A yas , say, then one 
can define zi{t) := y„i(t - 1), Z2{t) := y^^it - 1) A ya-^it - 1), V- [t) := zi{t - 1) A Z2{t - 1). 
Similarly for longer disjunctions and each and also similarly for /ij, in which case A is 
replaced by V at each step. This produces a computation of hi in nii steps for each i. 
Finally, after introducing further additional variables at each component i if necessary to 
compensate for unequal lengths of the expressions for V'j-, the Boolean vector /i(yi, . . . , yL+2) 
can be computed in exactly m = max(mi, ...,171^) steps. □ 



Remark 5 Without loss of generality, we can assume that for every state variable s in the 
network B, there exists some input variable di or ai and a directed path from this input 
towards s. Similarly, we can assume that for every state variable s, there exists an output 
variable oi such that there is a directed path from s to Ci. 

If that wasn't the case for some s, one could delete s from the system without altering 
equation By choosing a suitable coding of integers < 2^ we may assume that the 

Boolean function g to which we will apply Lemma U] is such that 

5(1,0,... ,1,0) = (0,1,0,1,... ,0,1). (7) 

It follows that each hi as in the proof of Lemma [5] is non-constant and no output variable 
will be deleted. 

Lemma U] can be used to compute a function g* which will be used in a way analogous 
to 7 in equation ([T]). More precisely, let F be an injection that maps the set of integers 
{0, . . . , 2^ - 1} into A\{START} in such a way that F(2^ - 1) = ACTIVE. Such a function 
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exists as long as L is sufficiently large relative to t, we will describe a suitable choice for L 
in the next subsection. Let g : A ^ Ahe such that g{a) = r(r~^(a) © 1), where © denotes 
addition modulo 2^, for a in the range of F, and (7(START) = START. Let g* be the 
corresponding function on A x {(0, 1), (1,0)} given by LemmaHl 
Now define Si = {a\, . . . ,al) for i G [A^] and let 



Again, one can naturally think of this system as a Turing machine that operates on L 
simultaneously advancing circular tapes, with Si representing the i-th cross-section of these 
tapes. The machine reads the value of Si and writes to Sm- 

If this system starts in a state where Si = START and Si is in the range of T for all 
i > 1, then the dynamics on these tapes will code the dynamics of the system described in 
the previous subsection. In particular. Lemma [3] implies that such states are contained in 
orbits of length at least 2^^^~^\ 

It remains to show that the dynamics on d described by ([9]) can be implemented in 
such a way that the whole system becomes bi-quadratic, cooperative, and has a strongly 
connected digraph. Unfortunately, Lemma |4] cannot be used for this purpose because the 
desired output depends not only on Si{t — 1) but on the history (of unknown length) of 5i 
since the last time when took the value START. This history is summarized by the 
value of d{t — 1), but the problem is that ([9]) has n inputs, with d{t — 1) acting as input for 
the computation of d{t), which poses a problem for implementation by quadratic functions. 
The following lemma shows how this problem can be solved. 



Lemma 6 There exists fi > and a Boolean network D with input vector p = (pi, . . . ,pl), 

and output vector q = {qi,q2), such that the following holds for any initial condition of D. 

Consider any sequence of inputs p(0), j5(l), . . . ,p{M), M > 1, such that 

i) p{t) eA,forO<t<M, 

a) p{0) = START, and 

Hi) p{t) / START, forO<t< M. 

Let j>0 be such that p{t) = ACTIVE forl<t< j, p{j + 1) / ACTIVE (or p(l) = . . . = 
p{M) = ACTIVE and j = M). Then 



Furthermore, the network B is cooperative, every node of its associated digraph has in- 
and outdegree of at most 2, and the indegree (outdegree) of every designated input (output) 
variable is 0. 



S,{t):=S,+i{t-l), i = l,...,N-l 
SN{t) ■.= g*{Si{t-l),d{t-l)), 

Define the dynamics for the variable mode{t) = d{t) by 



(8) 




(9) 




(10) 
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Figure 2: The digraph of the network D which is used to compute the output qi from the 
input p. The formulas for each interaction (i.e. A,V) are omitted in this figure. 

Proof: The idea of this proof is based on the simple system c{t) = u{t — 1) V d{t — 1), 
d{t) = v{t — 1) A c{t — 1), with inputs v. This switch d is turned on by letting both inputs 
u = \ and V = 1 for a short time, after which u can be turned to while v is left equal 
to 1. After letting u = for a short time, the switch resets and doesn't restart even \i v = 1 
again. 

Let t = without loss of generality; the more general case being completely analogous. 
For the sake of clarity assume for now that < j < M, but the same construction allows 
for j = and j = M as described below. See Figure [2] which displays the circuit described 
below. Define for the moment u{t) := — 1) A . . . A Pl/2{^ ~ l)i ^(0 •= Pl/2+i(^ — 1) A 
• • • ApL(t — 1) (a modification of this definition with additional variables and indegree two is 
displayed in the figure and described below). Thus u[t) = 1 if and only \ip{t — \) = START, 
and v{t) = 1 if and only if p{t — 1) = ACTIVE, since by assumption p{t) S A. 

Define 

ui{t) := u{t - 1), U2{t) := u{t - 1) V ni(t - 1), U3(t) := U2{t - 1), UA{t) := usit - 1), 

vi{t)=v{t-l), V2{t) =v{t-l)Avi{t-l), vsit) ■.= V2{t-l), Vi{t) :=V3{t-l)Vwi{t-l), 
Wo{t) := ui{t - 1), wi{t) := Wo{t -1) Avi{t- 1), 
c(t) := Ui{t - 1) V d{t - 1), d(t) := v^^t - 1) A c{t - 1). 

Intuitively, ^4 is a time-transposed copy of u where every 1 has been doubled due to 
the feed-forward loop at U2- Also, U4 is similar to a time-transposed copy of v where every 
has been doubled. The auxiliary variables Wi only play a role at a single time step as 
described below. The loop c d forms the core of the switch in the system. 

A simple calculation shows that ^4(4) = 7x4(5) = 1, U4(t) = for 5 < t < M + 4. 
On the other hand, since v[l) = 0,u(2) = . . . = ^(l + j) = 1,^^(2 + j) = 0, we infer that 
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V2{2) = V2{3) = 0, V2{t) = 1 for 3 < t < 2+j, V2{3+j) = V2{4.+j) = vsi^+j) = V3{5+j) = 0. 
It follows that wi{3) = (since ^1(2) = 0), and that wi{4:) = 1 if and only if ui(3) = 1 
(since wq{3) = 1). This in turn holds since we are assuming for now that j > 0. Also, 
wi{s) = for s > 4. 

We use the data for wi and v-^ to compute the values of V4. From wi{3) = ^3(8) = 0, it 
follows that ^4(4) = 0. From "^1(4) = 1 it follows that ^4(5) = 1, and using v-^ we similarly 
infer that v^it) = 1 for 4 < t < 4 + j. Also, ^4(5 + j) = ^4(6 + j) = 0. 

We conclude that c(5) = 1, d(5) = 0, regardless of the values of c, d at earlier time steps. 
Since j > 0, one has c(6) = 1, d{6) = 1, and in general c(t) = d{t) = 1 for 5 < t < 5 + j. 
Then c(6 + j) = I, d{6 + j) = (because ^74(5 + j) = 0). It follows that c{t) = d{t) = for 
7 + j <t<5 + M, and d{6 + M) = 0. 

In particular d{t) = 1 for exactly j time steps, 5 < t < 5 + j, and then d{t) = for 
6 + j<t<6 + M. Since we want the variable qi to be equal to 1 during exactly j + 1 time 
steps, we define the additional variables 

W2{t) := Wo{t - 1), W3{t) := W2{t - 1), qi{t) := Wsit - 1) V d{t - 1). 

Calculating that w-s{5) = 1, w-s^t) = for 5 < t < 5 + M, we conclude that qi{t) = 1 for 
6 < t < 6 + j, and qi{t) = for 6 + j < s < 7 + M. 

The case j = is very similar to the one above, except that wi (4) = (instead of 1 for 
j > 0), i;4(4) = ^4(5) = 0, and therefore d{t) = on all 6 < f < M + 6. Thus qi{6) = 1, 
and qi{t) = for larger values of t. 

In the case j = M, one can compute f4(t) = 1 for 5 < t < M + 5. This allows the 
variables c(t), d{t) to remain equal to 1 up to and including t = M + 5. Therefore qi{l) = 1 
up to and including t = 6 + M. 

In order to define the variable q2, it suffices to use a construction dual to the previous 
one (recall that simply negating qi is not permitted). That is, define u{t) := Pl /2+i{'t — 1) V 
. . . y piit — 1), and v{t) := pi{t — 1) V . . . \/ PL/2{t ~ 1); i^i such a way that u{t) = if and 
only \ip{t - 1) = START, and v{t) = if and only if p{t - 1) = ACTIVE. Define variables 
uiiVi etc. similarly as above, except that every A in the function definition is replaced by V 
and vice versa. Then it will necessarily follow that q2 = ^qi on the interval 6 < t < 6 + M. 
Using the value = 6, equation (fTO]) is satisfied. 

Notice that the system described so far is cooperative, and that all in- and outdegree 
requirements are satisfied except for the indegree of the variables u, v, u, v. These terms can 
now be replaced in a routine manner by a cascade of variables (see Figure [2]) , in such a way 
that u{t) = 1 if and only if p{t — t) = START, etc., for some r > 1. This will increase the 
delay /j, but leave the computations and the other properties of this system unchanged. □ 

Using the function g defined above, we consider the cooperative networks B and D from 
Lemmas [4] and m Recall that B (D) has variables a,d (p) which are specifically designated 
as inputs, variables c (q) specifically designated as outputs, and a 'processing delay' m (/x). 
The cooperative network, which will be denoted by 5, is defined by B and D, together with 
the equations 
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Si{t) :=5i+i(t-l) 
SN+i{t) :=c(t-l). 



i = m + 2,m + 3, . . . , N, 



(11) 



and 



a{t) 

m 
Pit) 




(12) 





N+1 



Figure 3: The network interconnections of the system S given by B, D, and equations (jlip . 
(fT2|) . The variables 5i, . . . , Sm+i are displayed in a box to indicate that they are not part 
of S but only included in the proof of Lemma [8l 

See Figure [3] for an illustration. In order to get an orbit of length 2^^, we need to code 
integer {0, . . . ,Ni — 1} in blocks of the form Si, and we need an additional block Sj 
to contain START and thus mark the beginning of the coded sequence. Since both of the 
subnetworks used in the construction of this system contain only the Boolean operators 
A,V in their expression (and no negations), it follows from (jll|) and (jl2p that the same is 
the case for the full network, hence the system is cooperative. 

Proposition 7 The digraph of the Boolean networks is strongly connected and bi-quadratic. 

Proof: The fact that every in- and outdegree is at most 2 follows directly from equations 
(jlip , (jl2p and Lemmas S] and [6l taking into account that the indegree (outdegree) of every 
input (output) variable is zero within their respective subnetwork. See also Figure [31 

In order to show the strong connectivity of the digraph, first we show that there exists 
a directed path from every node in the network to the node qi, the first component in 
the output of D. It is clear from the circuit defining D that every input variable pi has a 
path connecting to qi (the first L/2 components of p through the variables u, ui,... and 
the last L/2 components through v,vi,...). Therefore every variable in Si can reach qi 
as well. By Remark [5l the same applies to every variable of c, and thus to every variable 
in the subnetwork B. Thus the same applies also to q2, and hence to every state in the 
subnetwork D. 
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Now we show that there exists a path from qi to every node in the network. Suppose 
first that there exists Cj such that neither di or d2 contains a path towards Cj. This would 
imply that gj{x) = Xj for every argument x G A, hy equation But this is not possible 
if g is chosen so that ([7]) holds. Thus for every j, there exists a path from either di or d2 to 
Cj (and therefore from qi or q2 to Cj). 

Since there exists a path from qi to q2, it follows that there is a path from qi to every Cj. 
Thus every component of every state Si, p, and a can be reached by a path from qi. Every 
state in B can be reached from di and hence qi, once again by Remark [5j the same applies 
to q2, and every state in the subnetwork D. □ 

Lemma 8 Let N > 3m + 3/i + 5. Then the system S has an orbit of length greater than 
or equal to 2^^ . 

Proof: Let be the Boolean network obtained from S by adding blocks of variables 
5*1, . . . , Sm+i of size L each (as shown in Figure [3]), with Si{t) := Si^i{t — 1) as in ([TT]) 
also holding for i = l,...,m + l. These variables cannot change the length of the original 
system's orbits since they don't feed back into it, but they can nevertheless be used for the 
study of the network. Let us call a state 5''^(0) of 5"*" pre-canonical if 5'^_|_^_|_2(0) = START 
and 5*^^(0) € range{T) for i ^ m + fi -\- 2. Let us call a state S'*(0) of 5"*" canonical if there 
exists a pre-canonical state £'"''(0) so that ^^(O) G range(T) for all j with N—m—fi—l < j < 
+ 1 and S*(0) and S~^{m + n + l) agree on all remaining nodes. Note that our assumption 
on N implies in particular that S* (0) = S^{n + /i + 1) for all i = 1, . . . 2m + 2/i + 4. A state 
of S that can be obtained by removing 5i U • • • U 5^+1 from a canonical state of 5+ will be 
called a proper state. 

We will show that every canonical state of 5"*" belongs to an orbit of length at least 2^^ 
of 5"*". Since the variables in Si U • • • U 5^+1 do not act as inputs to variables in S, it will 
follow that every proper state of of S belongs to an orbit of length at least 2^^ of S. 

So let S'*(0) be a canonical state of S~^, and let 5*^(0) be a corresponding pre-canonical 
state. After fi iterations we will have 5'^_|_2(a*) = 5*^+^+2(0) = START and q~^{fJ^) = (1, 0) by 
the choice of subnetwork D and Lemma[6l Thus d~^{fi + l) = (1, 0) and a"'"(/x + 1) = START 
by (I12p . By the choice of subnetwork B and Lemma|4]and the assumed relationship between 
S* and 5+ we will have c*(0) = c+(m + /i + l) = S^{m + fi + l) = START = 5J(0). By 
this implies 5*^+1(1) = START. 

More generally, let us define for t > 1 the value of mode{t) as q'^ {t + ^) \i t < m + ^ 
and as g*(t - m - 1) if i > m + /i + 1. Let j be such that S*{1) = ACTIVE for l<i< j 
and S*j^^ 7^ ACTIVE. It follows from the choice of subnetwork D and Lemma [6] that 

mode{t) = (1, 0) = switch, 0<t<j; mode{t) = (0, 1) = rotate, j + l<t<N. (13) 
Similarly, by the choice of subnetwork B and Lemma |4] 




Sl{t — 1), if mode{t — 1) = rotate, 
g{S\{t — 1)), if mode{t — 1) = switch. 



(14) 
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Thus when starting in a canonical initial state, our system behaves exactly as specified 
in ([8]) and Q and the lemma follows. □ 



4.1.4 The Choice of I and L 

We can use Lemmas [7] and [8] to prove the theorem stated in the introduction. Let < c < 2 
be arbitrary. We prove first that there exist L > even and an integer i > such that 

The second inequality is equivalent to L/i < In 2/ In c; thus let L be an even integer 
with L = wi, for some fixed 1 < w < In 2/ Inc. Using Stirling's formula, we have (^^2) 

V 2^ /\/2ttL for large enough L, where < < 1 is arbitrary and fixed. The first inequality 
in (lisp is satisfied if v 2^/\/27rL > 2^. But after replacing L = wi this is equivalent to 
2(u>-i)£ y v~^V2Trwi. Clearly this inequality is satisfied for sufficiently large £, hence ([15]) 
follows. 

The first inequality is now used to carry out the construction of system S, which by 
Lemmas [7] and [8] is cooperative and bi-quadratic with strongly connected digraph, and has 
an orbit of length greater than or equal to 2^^. It remains to show that 2^^ > for 
sufficiently large > 0, where n is the dimension of the system. 

Let T be the total number of variables in the subnetworks D, B. Note that T depends 
only on L, I, and not on A^. Then n = {N + 1 — (m + 1)L + T = NL — mL + T. Notice 
that c" < 2^^ if and only if {NL - mL + T)lnc < Nl In 2, which holds if and only if 

Line < £ln2 + ^ Inc. 

But this equation is satisfied for large enough A^, since Line < £ln2 by (fT5]) . □ 



4.2 Proofs of parts (ii) and (iii) 

Let (S,/) be a bi-quadratic cooperative Boolean system of dimension n — 2 that contains 
an orbit of length c". Let 11 = {0, 1}["1, let gk = fk whenever k < n — 1 and fk is strictly 
quadratic, let = Si^. A Sn whenever k < n and fk = Sj^., and let Qn-i = Qn = Sn-i A Sn- 
Then (11, g) is cooperative, quadratic, and has only strictly quadratic regulatory functions. 
Now let s G S be a state in an orbit of length at least c" of (S, /), and define a state s* S 11 
by s* = [si, . . . , Sn,-2, 1) 1]- Then the orbit of s* in (IT, g) has the same length as the orbit 
of s in (S,/). This proves part (ii). 

For the proof of part (iii), let us define Boolean vector functions / and h on four- 
dimensional Boolean vectors s = (51,52,53,54) as follows: 

/(s) = (Sl A 52, 51 A 53, 52 A 54, 53 A S4), 
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h{s) = (si V S2, si V S3, S2 V S4, S3 V S4). 
Table shows the values of f,h,ho /, and foh. 



s 


m 


h{s) 


hof{s) 


foh 


1111 


1111 


1111 


1111 


1111 


1110 


1100 


1111 


1110 


1111 


1101 


1010 


1111 


1101 


1111 


1100 


1000 


1110 


1100 


1100 


1011 


0101 


1111 


1011 


1111 


1010 


0100 


1101 


1010 


1010 


1001 


0000 


1111 


0000 


1111 


1000 


0000 


1100 


0000 


1000 


0111 


0011 


1111 


0111 


1111 


0110 


0000 


1111 


0000 


1111 


0101 


0010 


1011 


0101 


0101 


0100 


0000 


1010 


0000 


0100 


0011 


0001 


0111 


0011 


0011 


0010 


0000 


0101 


0000 


0010 


0001 


0000 


0011 


0000 


0001 


0000 


0000 


0000 


0000 


0000 



Let 

F = {nil, 1110, 1101, 1100, 1011, 1010, 0111, 0101, 0011, 0000}, 
H = {nil, 1100, 1010, 1000, 0101, 0100, 0011, 0010, 0001, 0000}. 

As Table 132] shows, ho f is the identity on F and f o h is the identity on H. 

Let L be a positive integer divisible by eight, and let p := L/4. Write [L] as a disjoint 
union of blocks of four consecutive integers i(l, r), i(2, r), i(3, r), i(4, r) for r S \p]. Call a 
Boolean vector s G {0, 1}[-^1 L-compliant if 

(a) iSi(l^r), Si(2,r), Si(3,r), Si{4,r)) G F for 1 < r < p/2, 

(b) {si(i,r), Si^2,r),Si(3,r),Si(^4.,r)) ^ H foT p/2 < r < p, and 

(c) s takes the value 1 exactly L/2 times. 

Lemma 9 Let ci < 10^/^. Then there exist a positive integer £ and a positive integer L 
that is a multiple of eight such that 2^ > cf' and the number of L-compliant Boolean vectors 
is larger than 2^. 

Proof: Let L be a positive integer that is an integer multiple of 16, and let V be the set of 
Boolean vectors s E {0, 1}^ that satisfy conditions (a) and (b) above. Since \F\ = \H\ = 10, 
it is clear that \V\ = 10^/^. 

For each s £ V define the signature of s as a{s) = (cti(s), . . . ,aQ{s)), where 
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ai(s) = \{r : 1 < r < p/2 k (si(i,r-), Si(2,r), ^^(3,^), 5^(4,^)) = (1111)}|, 

0"2(s) = \{r : l<r <p/2 Sz {Si(i^r), Si{2,r), Si(3,r), Si(4.,r)) = (0000)}|, 

CT3{s) = \{r: l<r<p/2k (^^(i,,), 5^(2,,), s^o,,), 5,(4,,)) G {(1110), (1101), (1011), (0111)}}|, 
0-4(5) = \{r: p/2<r <p k (si(i,^), Sj(2,r), 5^(3^^), 5^(4,^)) = (1111)}|, 

f^5('S) = \{r: p/2<r<pk {sn^i^r), Si{2,r), Si{3,r), Si^4,r)) = (0000)}|, 

ae{s) = \{r: p/2<r<pk (^^(i,,), 8^(2,,), 5^(3,,), 5,(4,.)) G {(1000), (0100), (0010), (0001)}}|. 

Let a"^"-^ = (1/16, 1/16, 1/4, 1/16, 1/16, 1/4). Well-known properties of binomial coeffi- 
cients imply that the inequality 

\{seV: a{s) = a}\ < \{s £ V : a{s) = (16) 

holds for any possible signature a. Moreover, observe that if s G ^ and a{s) = a"^""^ , 
then s takes the value 1 exactly L/2 times, and hence s is L-compliant. Since the total 
number of possible signatures is bounded from above by (L/4 + 1)^, it follows from (jl6p 
that the total number M of L-compliant Boolean vectors satisfies the inequality 

M > 



(L/4 + 1)6- 

Notice that limi^oo LlnlO^/"^ - 61n(L/4 + 1) - Llnci = 00. 
Thus for sufficiently large L we can find a positive integer i with 

LlnlO^/'^-61n(L/4 + l) > ^ln2 > Llnci, 

and the lemma follows. □ 

Now fix ci < 10^/^ and let L, £ be as in Lemma [9j Build an n-dimensional Boolean 
system {Il,g^) as in the proof of Theorem [^i) , but with the following modifications: 

• The blocks Si will have length L as before, but the set A will consist only of L- 
compliant vectors. 

• Proper initial states will be required to have only L-compliant vectors on each Si. 

• Instead of requiring Si{t + 1) = 5^+1 (t) for i G [N] and implementing this dynamics 
by monic functions, for i G [A^ — 1] we only require Si{t + 2) = 5j+2(t) and implement 
this dynamics as follows: Let Si be partitioned into blocks . . . , 6j^^/4 of four 
Boolean values each, with hi^r{t) G F for r < L/8 and bi^r S H for L/8 < r < L/4. 
Define bi^r{t + 1) = h{bi^i^r+L/8{t)) for r < L/8 and bi^rit + 1) = /(6i+i,r-L/8(0) for 
L/8 < r < L/4. 

This construction is possible by Lemma [9] and the observations on the functions /, h 
made above, and the exact same argument as in the proof of Theorem [TJ^i) shows that each 
proper state of (n.,g~) belongs to an orbit of length > Cg, where C2 is a constant that 
depends only on L and i and satisfies ci < C2 < 10^/"^. It is also straightforward to verify 
that the system is bi-quadratic and cooperative. 
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However, the system may not yet be strictly quadratic. We may still need to implement 
the dynamics Sj\[{t + 1) = Sjy+iit) by monic functions and assume wlog that fj, is even to 
assure that we have an exact copy of a previous value for Sj^^i when it is read as an input. 
More importantly, some of the regulatory functions in B L) D will be monic (see Figure [2] 
and Figure ED. However, the number U of nodes with indegree 1 is bounded by a number 
U{L) that depends only on L, regardless of n. 

Lemma 10 Suppose (H, g) is a bi-quadratic, 0.25-biased, n- dimensional Boolean network 
with exactly U monic regulatory functions and an orbit of length c". Then there exists a 
strictly quadratic, bi-quadratic, 0.25-biased, U -\- n- dimensional Boolean network (S,/) with 
an orbit of length c^ . Moreover, if{Il,g) is cooperative, then we can also require that (S, /) 
be cooperative. 

Proof: Let (H, g), U he as in the assumption. Since the sum of indegrees in a directed graph 
is equal to the sum of outdegrees, the number Ui of variables of (H, g) with outdegree 1 and 
the number Uq of variables with outdegree are such that U = 2Uq + Ui. Let {ui, . . . , uu} 
be the nodes of (il,g) with indegree 1, let {oi, . . . , 0{/q} be the nodes with outdegree 0, 
and let {p2Uo+ii ■ ■ ■ 1P2U0+U1} be the nodes with outdegree 1. We can construct (S, /) from 
(H, (7) by adding a set / = {ii, . . . ifj} of dummy nodes to the system as follows: 

• fur = 9ur ^ Sir fo'^ ^ ^ [^] 1 whcrc gu^ denotes the (monic) u^-th component of g, 

• fir = Sir V So,, for r G [Uq], 

• fir = Sir V So,+uo Uo <r < 2Uo, 

• fir = Sir V for 2Uo<r < U. 

Leaving the remaining regulatory functions unchanged, we obtain a bi-quadratic, strictly 
quadratic system (S,/) which is cooperative whenever (II, g) is. If the system starts in an 
initial state s(0) = (si(0), . . . , Sn(0), (0), . . .,Si^{0)) with {si^{0), . . .,Si^{0)) = (!,... 1), 
then we will have (sj^(i), . . . , Si^{t)) = (!,...,!) along the trajectory, and the dynamics on 
the original n variables remains unchanged. In particular, if (si(0), . . . ,,8^(0)) belongs to 
an orbit of {Ti,g) of length c", then s will belong to an orbit of (S, /) of the same length. 
□ 

Now extend (H, g~) to an n-\-U dimensional system as in Lemma [TOl The dimension of 
the extended system is bounded by n + [/ (L). Thus if we choose n sufficiently large relative 
to U{L) so that C2 > c^'^^^^\ we obtain the conclusion of Theorem [T^iii) . □ 

Theorem [T]^iii) is the special case a = 1 of the following more general result: 

Proposition 11 Let a,c be constants with < a < 1 and 1 < c < 10"/'^2-'^^". Then for 
all sufficiently large n there exist n-dimensional bi-quadratic cooperative Boolean networks 
that are c-chaotic and are not {an,n)-Turing systems. 
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Proof: Let a,c be as in the assumption, let ci, 02,03 be such that 1 < ci < 10^/^, 1 < 
C2 < C3 < 2, and c = cfcg"". Theorem [J already covers the case q = 1, so assume a < 1. 
We need to construct n-dimensional systems with the required properties that have > (3n 
strictly quadratic nodes. We can find Li, L2,ii,i2 such that Li,ii satisfy the conclusion of 
Lemma El 



L2/2 



and 



where 



> Co 



Now construct a cooperative, bi-quadratic, n-dimensional Boolean network as in the 
proof of Theorem [1] with blocks Si for i S [A^ + 1] of length Li + L2 each in such a way that 
that the values of the first Li variables in Si{t+1) will be computed from the variables in the 
first Li entries of 5'j+i(t) as in the proof of Theorem (TJ^iii) , and the remaining L2 variables 
of Si{t + 1) will simply be copied from the corresponding variables of 5j_|_i(t). The proof of 
Theorem [1] (with some very minor adjustments) shows that for sufficiently large n relative 
to Li + L2 the resulting system will be bi-quadratic, cooperative, will have more than an 
strictly quadratic nodes, and will have an orbit of length > 2^^'^'^^^^^ , where N ~ L1+L2 ' 
By our choice of Li, L2, ^1, ^2 we will have 



and the result follows. □ 



5 Appendix B: Proof of Theorem [2] 

A proof of Theorem [2] was reported in [T7]. Here we give a slightly improved version of this 
proof. 

We will prove Theorem [2] in two stages. In the first stage of the proof we will show that 
very large subsets of the state space H of an n-dimensional Boolean system must be balanced 
in a sense that will be defined shortly. In the second stage of the proof we will show that if 
S is the set of states in an orbit of an e-biased (6, r)-Boolean system and 5 is sufficiently 
balanced, then only a small fraction of the regulatory functions can be non-monic. 

5.1 Balanced subsets of the state space 

Let n = {0, be the state space of an n-dimensional Boolean system. Let S = {s^ : i € 
£.} be a sequence of (not necessarily pairwise distinct) elements of 11. If the elements of S 
happen to be pairwise distinct, then we will speak of S being a subset of 11. 
To illustrate the key idea of this section, let i G [n] and consider the ratio 
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If /3, 7 > 0, then we will say that S is l3-j-l-balanced if |{i € [n] : 0.5| > 7}] < /Jn. 

More generally, let r G [n] and a : [r] — > {0, 1}. For r-element subsets / = {ii, . . . ,ir} 
of [n] with ii < ■ ■ ■ < ir we define ratios £,f{S) as follows: 

c^fc:, _ K^e^V^x G [r] 4, = a(n)}| 



\C\ 



Define 



CKS) = max{2-l^l - ^i^) : ^ G {0, 1}^}. 



If 7 > 0, then we will say that S is 13 -j-r -balanced if for every family P of pairwise 
disjoint subsets / of [n] with | |J -P| > (3n and 1 < |/| < r for each I G P there exists I & P 
such that C/('5) < 7. 

We will prove the following. 

Lemma 12 Let r be a positive integer, /3, 7 > and assume 7 < 2^*". Ze^ 



A(7,r) 



1-2-^- + 7/ V2-''-7^ 
and let c be a constant such that 

c>2(A(7,r))^. 

Then for sufficiently large n, every subset S of {0, l}'"! of size > c" is [3 -^-r -balanced. 

Proof: Let (3, 7, r be as in the assumptions, and assume throughout this argument that n 
is a sufficiently large positive integer. Let ^ > 0, let 1 < c < 2, and let 5 be such that 
1 + £>7<(5<1 + 2q^ and (5c" is an integer. Let us assume that S = {s^ : £ G i^c"']} is 
a sequence of randomly and independently (with replacement) chosen states in {0, 1}^^^ of 
length 5c". We will treat S^j and Q as random variables and temporarily suppress their 
dependence on S in our notation. 

Let G [r]. For fixed I = {ii, . . . , i^} with ii < • • • < and a G {0, 1}'''' we define 

a _ l^e=i 'lie 
- 5c- ' 

where r/J^ = if s^{iu) = cf{u) for all u G [v], and ry^^ = 1 otherwise. 

Clearly, the mean value of r/J is £^(r?7) = 1-2"''. Note that 2l^l-^J < e iS rj^ -E{r]J) > e, 
and hence Cj>eiSrij- E{rij) > e for at least one a G {0, 1}^ . 

We want to estimate Pr{riJ — E{riJ) > e) for any given fixed e > 0. Note that the 
random variables rjf^ take values in the interval [0, 1] and are independent. This allows us 
to use the following inequality of [l5] (see also [241 [6] for the special case we are considering 
here) . 
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Lemma 13 Let Xi,X2, ■ ■ ■ ,Xm. be independent random variables such that < < 1 for 
i € [m] and let X = (Xi + • • • + Xm)/m. Let n = E[X) and let < e < 1 — fi. Then 

P,,X -.>.)< ((^)"" (^) i (17) 

We will assume until further notice that e < 2""" and thus satisfies the assumptions 
of (I17p . Both bounds in ()17p are of the form A™ for some < A < e~^^ < 1. For the 
moment, assume that A is such such a constant, and let m = (5c". Now it follows from ()17p 
that 

Pr{riJ -1 + 2^^' >e) < X^"" . 
This implies the following estimate for Q: 

Pr{Ci >e)< 2''X^''". 

Now fix A; < n and consider k pairwise disjoint subsets /i, . . . , 1^ of cardinality < r each. 
The random variables Q_^, . . . , are independent. It follows that 

Pr(Vm G [k] Ci^ > e) < r'^X''^"". 

Let k = f3n and let A be the event that there exists a family P of pairwise disjoint 
subsets / of [n] with | |J P| > (3n and 1 < |/| < r for each I £ P such that C/ ^ £ for each 
L £ P. The number of eligible families P is bounded from above by (")^" < n*^'^". Thus 
the probability of the event A can be estimated as 

Pr{A) < (2n)'^^"A^"'^'^". 
Now note that by Stirling's formula the number of subsets of 11 of size c" satisfies 



< r < 



n n /IN ^T'C 

e L ze-n \ 



Moreover, note that 



Thus for 



2 gnc" 



r/3 

lim (2n)c" = 1. 

n— >oo 



c > 2A^^ (18) 

and n sufficiently large, we will have 

(2n)i^A/'^<f^V'- 
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This in turn implies that for sufficiently large n and c as in (jlSp 



1 



Pr{A) < (2n)^^"A^"'5'=" = ( (2n)^A^^r' < < (19) 

V / c 2i „1 



r/3 flc\"c" ,2e" 

— ' ^ 

Now let us fix e such that < e < 7. Since 7 < 2~'', the assumptions of Lemma [T3l will 
be satisfied for this choice of e. Let B = B{S) be the set of the first c"" pairwise distinct 
elements of the sequence S, if in fact S has at least c" pairwise distinct elements, and let B 
be undefined otherwise. Let us make a few observations: 

1. Let N = {£ [(5c"] : 31 < j < £ = s^} be the number of entries in S that duplicate 
a previous entry. Note that B is defined iff < (6— l)c". In particular, by the choice 
of 5, the set B is defined as long as < g^c^. 



2. Note that the expected value of N can be estimated, for sufficiently large n, fixed 

2-c 
2c7 



c < 2, and < g < as 



— ^ < = o(l)c'^. 

2" 2" 

^6[<5c"] 



In particular, E{N) < ^c". 
3. Now it follows from Markov's Inequality 

<5- 1 



c"" > E{N) > Pr{N >{5- l)c")((5 - l)c" 



2 

that for fixed c and sufficiently large n, the set B will be defined with probability 
> 0.5. 

4. Assume B is defined. Observe that for each subset / of [n] and a G {0, Ijtl^ll we have 



The first inequality in (j20p turns into equality if 77^^ = whenever is outside of B; 
the second inequality in (j20p turns into equality if 77^^ = 1 whenever is outside of B. 
It follows from the relationship between the 7?j(5)'s and Cii^S) that 

By choosing g sufficiently close to 0, we can choose 6 as close to 1 as we need, and 
our choice of e < 7 implies that for 5 sufficiently close to 1 the inequality Cj{B) > 7 
will imply the inequality Cj{S) > e. 
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But if there is any subset B of size c" of 11 that is not P-'j-r balanced, then this subset 
will be exactly as likely to be equal to B{S) as any other subset of 11 of the same size. By 
point 3 above, the probability that B{S) exists is greater than 0.5, and thus the probability 

that B{S) exists and is equal to B must be at least 0.5(^„) ^ . But point 4 above implies 
that if B is not (5-j-r balanced, then B[C) = B implies that the event A has occurred, with 
contradicts inequality p^ . 

We derived the contradiction under the assumption that c satisfies inequality (llSp . Now 
assume 

c>2(A(7,r)f 

as in the assumption of the lemma. Then we can choose e sufficiently close to 7 and 
A = A(e, r) so that inequality (jlSp will hold as well for any J > 1. By choosing 5 sufficiently 
close to one we will get a contradiction whenever B exists and satisfies QiB) > 7- This 
proves Lemma [T2l □ 

5.2 Systems with balanced orbits 

Lemma 14 Let b,r be positive integers, letO<£,T< 0.5, let {Il,g) be an n- dimensional 
Boolean system, and let S be an orbit of (H, g). Let k G [n] be such that the bias A of 
satisfies |A — 0.5| > e, and let L be the set of input variables of gt- Then either Q{S) > 
orC|,|(5)>(l-r)e-i. 

Proof: Assume wlog that A > 0.5 + e; the proof in the case when A < 0.5 — e is symmetric. 
Suppose that Qi'S) < Then there exists a subset S* C S with \S*\ > (1 — t)|5| such 
that r]f{S*) = 2-1^1 for each a £ {0, 1}^. We conclude that 

IcSlCfc = \{seS: Sk = l}\ = \{s€S: gk{s) = 1}\ > \{s G S* : gk{s) = l}\ 
> (1 - r)|cS|A > (1 - r) \S\ (0.5 + e) > |cS| (o.5 + (1 - r)e - ^) , 

and the inequality Cjfc} > (1 — 7")e — ^ follows. □ 

Lemma 15 Let {Il,g) be an n-dimensional e-biased {n,r)-Boolean system, let < t < 
^_^Q g , /ei 7 = 7* = (1 — r)e — ^, and let j3, (5* > 0. Assume S is the set of states in an 
orbit of (n, (7) so that S is both P-j-r -balanced and (3* -1 -balanced. Then there exists a 
subset J C [n] of size \J\ < (/3 + rP*)n with the property that every non-monic regulatory 
function g^ has at least one input variable in J. 

Proof: Let K = {k G [n] : Clkji"^) — ">'*}• "^^^ assumption on S implies that \K\ < /3*n. 

Let Jo be the set of inputs of the variables in K. Then | Jo| < r(3*n. 

Let = [n]\K and let {/ci, . . . , kp} C be a set of variables maximal with respect 
to the property that is non-monic for every q £ [p] and the sets Iq of inputs of g^^ are 
pairwise disjoint. Let Ji = Uye[p] ^Q- 
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By Lemma [HI and the choice of ^ for each q G [p] we must have Q (S) > Thus 
the assumption on S imphes that | Ji| < 

On the other hand, by maximahty of {ki, . . . ,kp}, every non-monic regulatory func- 
tion must have at least one input in the set J := Jq U Ji, and the lemma follows. □ 

Now let {Il,g),e,a,b,r be as in the assumptions of Theorem [2l let 7,7* be as in the 
assumptions of Lemma [l5l and assume that P,f3* > satisfy 

P + rP* = ^. (21) 
Let A(7, r), A(7*, 1) be as in Lemma [T2l Then we will have 

c(e,Q,6,r) <max{2(A(7,r))^2(A(7M)r}. (22) 

To see this, assume n is sufficiently large and S is an orbit of (n, g) of length at least 
c"', where c exceeds the right-hand side of ()22p . Then Lemma [T2] implies that S is (3-j-r- 
balanced and /9*-7*-l-balanced and thus satisfies the assumptions of Lemma [T5j Let J be 
as in the conclusion of Lemma [El Note that at most b\J\ < an regulatory functions can 
have inputs in J, and it follows that (11,(7) is an (an, n)-Turing system. 

Note that by the second inequality in (jl7p we will in particular have 

c{e,a,b,r) < ma^{2e-^^'^ ,2e~^^^'^'^*}. (23) 
This concludes the proof of Theorem [2j □ 

6 Appendix C: Numerical Estimates for c{£, a, b, r) 

We formulated Theorem [2] as a qualitative result about existence of a constant. In this 
section we will use the notation c(e, a, 6, r) as shorthand for the smallest real number for 
which the conclusion of Theorem [2] holds and C(e, a, 6, r) for the upper bound for c(e, a, 6, r) 
that we get from our proof of the theorem. 

To arrive at more precise estimates of c(e, a, 6, r), we defined 7 = ^, 7* = (1 — T)e — 5, 
where r is as in the assumptions of Lemma [T5l and wrote a simple MatLab program 
for numerically exploring the values of the right-hand side of (j22p for r G (0, ^ ) and 
(3* G (0, ^). Note that the value of (3 is not a free parameter as it is given by (|2ip . 

For the cases that we numerically explored, we found almost perfect linear dependence 
of C(e, a, 6, r) on a. In particular, 



29 



C(0.25, 


a, 2, 2) 


^ 2 - 


0.0041a, 


C(0.25, 


a, 3, 2) ; 


« 2 - 


0.0027a, 


C(0.375, 


a, 2, 3) ' 


5i 2 - 


0.0040a, 


C(0.25, 


a, 2, 3) ' 


« 2 - 


0.0021a, 


C(0.125, 


a, 2, 3) f 


5i 2 - 


0.0007a, 


C(0.375, 


a, 3, 3) f 


« 2 - 


0.0027a, 


C(0.25, 


a, 3, 3) ' 


5i 2 - 


0.0014a, 


C(0.125, 


a, 3, 3) ' 


« 2 - 


0.0004a. 



Figure m summarizes these findings. 

2r 

1.9995 - 

1.999 - 
1.9985 - 

1.998 - 
1 .9975 - 

1.997 - 
1.9965 - 

1.996 - 

1.9955 - 


Figure 4: Dependence of C{e,a,b,r) on a. Solid blue: e = 0.25,6 = r = 2, Red: e = 
0.25,6 = 3,r = 2, Magenta: e = 0.375,6 = 2,r = 3, Black: e = 0.25,6 = 2,r = 3, Green: 
e = 0.125,6 = 2,r = 3, Yellow: e = 0.375,6 = r = 3, Dotted Blue: e = 0.25,6 = r = 3, 
Dashed Blue: e = 0.125, 6 = r = 3. 

The upper bounds C(e, a, 6, r) appear to substantially overestimate the values c(e, a, 6, r). 
For example, notice that C(0.25, 1, 2, 2) ^ 1.9959. Note that for c > c(0.25, 1, 2, 2) no 
strictly bi-quadratic 0.25-biased Boolean network can be c-chaotic. Thus Theorem miii) 
gives a lower bound c(0.25, 1,2,2) > 10^/"^ w 1.7783. We prove below that 10^/"^ is in fact 
the correct value of c(0.25, 1, 2, 2). 

Let us call a vector (i^i, . . . of Boolean functions on {0, 1}^ with |I| = n a Boolean 
n-block if each of the functions gi is strictly quadratic, has bias A = 0.25 or A = 0.75, and 
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each i £ I acts as input to exactly two among the functions gi, . . . ,gn. A Boolean n-block 
is minimal if there is no proper subset J C [n] such that the gj^s for j £ J form a Boolean 
I J|-block on some proper subset of /. 

For example, let us consider a Boolean n-block G = {gi, . . . , g^) on / = [n] with n > 2. 
Wlog, gi has inputs si, S2, and si is also an input of g2- If S2 were the other input of 52 > then 
{91^92) would form a Boolean 2-block on [2], and G would not be minimal since we assumed 
n > 2. Thus we may wlog assume that the other input of 52 is S3. Inductively arguing like 
this we can convince ourselves that if G is minimal, then after a suitable renumbering of 
the input variables we can assume wlog that g^ takes inputs Sj, Sj+i for all i G [n — 1] and 
gn takes inputs si,s„. 

Let us define R{n) for n > 2 as the maximal size of the range of a minimal Boolean 
n-block, and let Q{n) = (i?(n))V". 

Lemma 16 Q{n) < 10-'^/'^ for all integers n > 2. 

Proof: Let {gi, . . . ,gn) be a minimal Boolean n-block, and assume wlog that gi takes input 
variables Si, Sj+i for i < n and gn takes input variables Sn, si- Let the opening of the block 
be the vector of Boolean functions {gi, ■ ■ ■ , gn) where gi, . . . , gn-i are as before, but gn 
is now treated as a Boolean function with inputs Sn,Sn+i- We will not make a notational 
distinction between a Boolean n-block and its opening. Note that the definition of a Boolean 
n-block implies that each g^ is canalyzing in both variables. 

Assume wlog that the canalyzed values of all gi are 1; if not, we can replace gi by ^gi 
without altering the size of the range of ((71, ... , gn) on any given set of input vectors. 

Let {gi, . . . , gn) be the opening of a minimal Boolean n-block. Define 

• /qo as the set of input vectors (si, . . . Sn+i) such that si takes the value that does not 
canalyze gi and s^+i takes the value that does not canalyzes gn, 

• loi as the set of input vectors (si, . . . s^+i) such that si takes the value that does not 
canalyze gi and Sn+i takes the value that canalyzes gn, 

• Iio as the set of input vectors (si, . . . Sn+i) such that si takes the value that canalyzes 
gi, and Sn.+i takes the value that does not canalyze gn, 

• 111 as the set of input vectors (si, . . . Sn+i) such that si takes the value that canalyzes 
gi, and Sn+i takes the value that canalyzes gn- 

Let Rij be the range of (gi, . . . ,gn) restricted to lij. 

Proposition 17 Let n > 2. Then |i?oi U Rio\ < |i?oo U Rn\. 

Proof: Let r = (r2, . . . be a Boolean vector. It suffices to show for k G [4] that if 

exactly k among the vectors irj for i,j £ {0, 1} belong to Rqi U Riq, then at least k among 
these vectors must belong to Rqq U Ru. 
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For k = 1 this is obvious, because the vector Irl always belongs to Rqq U Rh. 

For /c = 4 it is vacuously true, since the output vector OrO can never belong to RqiURiq. 

For k = 2, assume wlog that Orl G i?oi; and let s = (si, . . . , s^+i) be a corresponding 
input vector. If s is obtained by flipping the value of Sn+i to 1 — s^+i and leaving s 
otherwise unchanged, we get an input vector s' G /qo with output Orj for some j G {0, 1}, 
and it follows that both Irl, Orj G Rqq U Rn. 

For A; = 3, let s^,s'^,s'^ G /qi U Ao with outputs Orl, Irl, IrO respectively. Then G 
Iqi,s^ G Iio, and wlog G /lo- Again, flipping the last value of gives an input in Iqq 
with output Orj, and flipping the first value of of ■s'^ gives an input in Iqq with output irO. 
If i / or j 7^ we are done. If not, consider the vectors {s2, ■ ■ ■ , s^) and (s^; • • • , s^). 
If there is some i with 2 < i < n so that sj = s^, then we can form an input vector 
{s\, . . . , sj, . . . , G loo with value Orl, and we are done. If not, then we must have 

(r2, . . . , r„_i) = (1, . . . , 1), since the non-canalyzed value can only be taken if both inputs 
are at their non-canalyzing values. In this special case we can consider two input vectors 
in Iqq where Si is the canalyzing value for gi for z = 2, . . . , n — 1 and Sn is arbitrary. The 
output vectors will be jrO and jrl for some j G {0, 1}. Since we need to consider this last 
case only if we have already found that OrO G Iqq, we are done. □ 

Now let us consider a minimal Boolean n-block ((71, ... , gn)- but let us for the moment 
assume that gn-i takes inputs Sn-i,s„. The range of this block is equal to the range of 
its opening restricted to inputs such that si = Sn+i- If the canalyzing value of si for gi is 
equal to the canalyzing value of s„ for gn, then the size of the range of the block (gi, . . . , gn) 
is equal to |i2oo U otherwise it is equal to |i?oi U i?io|. This gives the following: 

Corollary 18 Let {gi, . . . ,gn) be a minimal Boolean n-block whose range is of maximum 
possible size. Then we may wlog assume that each input variable has the same canalyzing 
value for both its output functions. 

Proof: Suppose {gi, . . . , gn) is a minimal Boolean n-block whose range is of maximum 
possible size, with minimum number m of input variables with different canalyzing values 
for their two output functions. Assume towards a contradiction that m > 0. Without loss of 
generality, the first input variable has two different canalyzing values. Consider Rij defined 
for its opening. Then the range of the Boolean n — 1-block (gi, . . . ,gn-i) has size |i?oiU-Rio|- 
Replace gn by so that gn{si,Sn) = /n(-si,l — Sn) for all si,Sn- Note that this does not 
alter the definitions of the sets Rij. Thus we obtain a minimal n-block {gi,... ,gn-i,fn) 
whose range has size |i?ooUi?ii|, which still must be maximum by Proposition [T71 However, 
the canalyzing value of si for gi is now equal to the canalyzing value of si for /„, which 
contradicts the choice of m. □ 

Note that the size of the range of such a Boolean n-block {gi, ■ ■ ■ ,gn) does not change if 
we replace one of the functions gi by -15, or if we simultaneously replace functions gi,gi^i 
with gi o -iSj and g'j+i o -iSj. Thus Corollarv 1181 implies that the maximum value for R{n) 
is always attained by the minimal Boolean n-block {gi, . . . , gn) where gi = siM Sj+i for 
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i G [f^ — 1] and gn = siVs„. We will from now on assume that a {gi, . . . ,gn) is this particular 
n-block. Note that, in particular, the canalyzing and canalyzed values will always be 1 in 
this case, for all gi and all input variables. 

Note that an output vector (ri, . . . , r„) of (51, ... , gn) cannot contain an isolated 1, that 
is, there cannot be i G {2, . . . , n — 1} with Sj = 1 and both Sj_i = = or si = 1 and 
•S2 = Sn = or s„ = 1 and si = Sn^i = 0. Let a„ be the number of Boolean vectors of length 
n without isolated ones. The recursion a„ = 2a.„_i — a„_2 + On-a has been reported in [5], 
and it follows that lim„^oo Om"^ = A, where A = 1.7549 is the real root of — + x — 1. 
For n > 3 the number On has been reported online as A"''"^ rounded to the nearest integer 
(see sequence A109377 in pTl). This already implies Lemma[T6l At the time of this writing, 
no complete proof of the latter is given in [11] . We include here an independent calculation 
of |-R(?^)| that uses a different recursion. 

Fix n >2 and consider the opening (i^i, . . . ,gn) of the minimal n-block of V-functions. 
For j £ {0, 1} and i £ [n] define: 



Pj{i) as the size of the range of {gi,...,gi) restricted to inputs with si = j and 
Si+l = 1, 

• qj{i) as the size of the range of {gi,...,gi) restricted to inputs with si = j and 

Sj-|_i = 0, and 

• rj{i) as the size of the range of {gi, . . . ,gi) restricted to inputs with si = j. 

It is easy to see that po{l) = Pi(l) = Qoi^) = qi{^), '''i(l) = !> and ro(l) = 2. 
Now assume i £ [n—1] and (ri, . . . , r^+i) is an output vector of (gi, . . . , gi+i). If ^j+i 7^ 1, 
then we must have Sj+i = = Si+2- Similarly, If rj+i = 1, then we must have Sj+i = 1 or 
= 1. This observation leads to the the following recursive relationships: 

• Pj{i + 1) = 

• + 1) =Pj{i) +Qj{'i), 

• rj{i + 1) = qj{i) +rj{i). 

In other words, we have {pj{i + l),qj{i + l),rj{i + l))'^ = M *{pj{i),qj{i),rj{i))'^ , where 



M 



1' 

1 1 
1 1 



The characteristic polynomial of M is A'^ — 2A^ + A — 1, and the eigenvalues are Ai = 
1.7549, A2 = 0.1226 + 0.74491, A3 = 0.1226 -0.7449i. The normal eigenvector corresponding 
to Ai is wi = (0.4140,0.5484,0.7265)^, and the vectors W2 = (-1.3117,0.8688,-0.1608)^, 
^3 = (0) —0.7376, 0.9771)"^ span the eigenspace of eigenvalues A2, A3. Note that the norm of 
M on the subspace spanned by W2, 103 is | A2I = 0.7549. The vector (1, 1, 1)-^ can be written 
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in base W = {wi,W2,W'i) as ui = (1.7443,-0.2118,-0.3084)'^, and the vector (1,1,2)^ 
can be written in this base as uq = (2.3107,-0.0331,0.3234)'^. Let L = W'^MW be the 
transition matrix in the new base. We will have for all i = 2, . . . , n and j G {0, 1}: 

= Wn-^Uj = )^^^Uj{\)wi + aijW2 + ftjws, (24) 

where ||(a„-,ftj)ll < M-^\\uj{2),Uj{'i)\\- 
By a simple calculation the latter implies that 

\\ai,jW2 + Aj^^sll < 0.3409 (25) 

for alH > 4 and j G {0, 1}. 

Let i?00i-Rii be defined as above. Then |iioo| = '?oo("') and \Rii\ = rii(n). In order to 
calculate |i2ooU-Rii|, we need to find |i2oon-Rii|. The Boolean vectors in RqqC^Rh must take 
the value 1 both on the first and the last coordinates for some inputs s with si = Sn+i = 0. 
This will happen iff S2 = Sn = 1, and we conclude that |i?oo H Rii\ = pn{n — 2). By the 
argument preceding Corollary [TSl this implies |i?oo H Rii\ = qoO{n) +pii(n) — pii(n — 2), 
and it follows from ([M]) and ([25]) that 

\R{n)\ = X'^~\uo{l)wi{2) + uiwiil)) - X^^-^iWiil)) + rem(n), (26) 

where |rem(n) < 1.1 for n > 6. 
We conclude that 

gin) < iX^,~\Xl{uoil)wii2) + mwiil)) - mu;i(l)) + 1.1)^/", (27) 
for all n > 6. 

The right hand side of (I27p is less than 10^^^ for n > 6, and Lemma [16] follows by 
directly calculating |i?(2)| = 3 = 1.7321^, \R{3)\ = 5 = 1.7100^, \R{4)\ = 10 = 1.7783^, 
|i?(5)| = 17 = 1.7623^ \R{6)\ = 29 = 1.7528^ □ 

Theorem 3 Suppose there exists a strictly quadratic, bi- quadratic, 0.25-hiasedn- dimensional 
Boolean system (IT, g) with an orbit of size c". Then c < 10^/^^. 

Proof: Let (n,g) be as in the assumption, and let C be an orbit of size c". Let g = 
max{£»(fc) : 2 < k < n}. Call a subset / C [n] closed if there exists a subset J{I) C [n] 
with I J(/)| = |/| such that each gj for j € J takes inputs from /, and call I minimal closed 
if no proper subset of / is closed. Since each node i has both in- and outdegree 2, [n] is the 
union of pairwise disjoint minimal closed sets 1^, for k G [K], with 2 < < ?7, for all k and 
J{Ik) n J{Ik') = for k 7^ k' . Note that X^^^ \Ik\ = n. For each k the vector of regulatory 
functions {gi^k-, ■ ■ ■ )9|4.|,fc) for elements of J(/fc) forms a minimal Boolean |/fc|-block. 



Qjii) 
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If s G C, then s = g{r) for some r £ C, and the restriction of s to J{Ik) must be in the 
range of {gi^k, ■ ■ ■,g\ik\,k)- It follows that 

K K 

c'^=ici<n^(i4.i)<n^"''=^"' 

fc=l k=l 

and the theorem is a consequence of Lemma [161 D 
Corollary 19 c(0.25, a, 2, 2) < lO^^-")/^ /or a// a G [0, 1]. 

Proof: Suppose (11, g) is a with at least an strictly quadratic regulatory functions and 
an orbit of length c" for some c > 1. By Lemma [TOl there exists a strictly quadratic, bi- 
quadratic, 0.25-biased, (2 — a)n-dimensional Boolean network (S, /) that also has an orbit 
of length c". By Theorem [3l we must have c" < (10^/^)^^"'^)", and the result follows. □ 

The upper bound for c(0.25, a, 2, 2) of Corollary [19] is less than our previous upper 
bound C(0.25, a, 2, 2) for 0.7987 < a < 1, but becomes meaningless for a < 0.7959, since 
(10i/4)(2-o.7959) ^ 2. Note also that for < a < 1, both upper bounds for c(0.25, a, 2, 2) 
exceed the lower bound l0"/42(i-°) < c(0.25, a, 2,2) given by Proposition 1 11[ 

While we believe that all upper bounds C(e, a, b, r) substantially overestimate c(e, q, b, r) 
we want to point out that the method of the proof of Corollary [19] does not easily generalize 
to cases where 6 7^ 2 or r 7^ 2. 

7 Appendix D: j9-Fluid and ^-Unstable Turing Systems 

Definition 20 Let s(0) be an initial state of a Boolean system. We say that the i-th variable 
is eventually frozen for the initial state s{0) if Si{t) takes one of the values 0, 1 only finitely 
often along the trajectory of s{0). 

Let p G (0, 1] and let k be a nonnegative integer. A Boolean system is p-fluid if with 
probability at least p a randomly chosen initial state has a proportion of at most p eventually 
frozen variables. 

A Boolean system is p- unstable if a random single-bit flip in a randomly chosen initial 
state moves the trajectory into the basin of attraction of a different attractor with probability 
at least p. 

Here we prove that Theorem [T]^i) can be strengthened as follows: 

Theorem 4 Let c,p be positive constants with c < 2, p < 1. Then for all sufficiently large n 
there exist n-dimensional cooperative Boolean networks that are simultaneously bi-quadratic, 
c-chaotic, p-fluid, and p-unstable. 

Sketch of the proof: Let p, c be as in the assumption, and let (IT, g) be an n-dimensional 
Boolean system as constructed in the proof of Theorem [T]^i). As in Figure[3l let iSi, . . . , Sn+i 
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denote the blocks of the (extended) system, with Si{t + 1) = Si^i{t) for i < N + I and 
S'Ar+i(i+l) = Si{t) or 5'jv+i(t+l) = g{Si{t)) depending on the value of the internal variable 
mode. Then every proper initial state of the system (as defined in the proof of Lemma [5]) 
is contained in an orbit of length at least c". 

However, most initial states are not proper. The idea of the proof of Theorem [3] is 
to modify the system in such a way that in most initial states there will be a sufficiently 
small to such that we will have SN^i{t + 1) = Si{t) for all t > to. We can accomplish 
this by modifying the subnetwork D of Figure [3] so that in addition it will have a new 
pair of output variables (ri,r2). These will be computed as ri(t + 1) = ri{t) A rl{t) and 
r2{t + 1) = r2{t) V r2(t), where r|(// — 1) = iff p{0) codes a subset of size less than 
L/2 and r2(/i — 1) = 1 iff p{0) codes a subset of size larger than L/2 (see Figure [3]). All 
internal variables of the modified system that are used in the computation of rl and 
will be different from the variables of the original system D. Finally, modify (jl2p so that 
diit) = qi{t - 1) A ri(t - 1) and d2(t) = q2{t - 1) V r2(t - 1). 

Let us define a proper initial state of the modified system as in the proof of Lemma [HI 
but requiring in addition that ri (0) , (0) , and all internal variables of used in the 
computation of r* are set to 1, and r2(0),r2(0), and all internal variables of used in 
the computation of are set to 0. In this case ri{t) = 1 and r2(t) = throughout the 
trajectory of any proper initial state, so the modification has no effect on d{t), and the proof 
of Lemma El remains otherwise unchanged. Thus the modified system will remain c-chaotic. 

Now suppose the modified system encounters a block Sm+fi+2 with fewer than L/2 ones. 
Then ri will take the value at most fj, time steps later, and will stay throughout the 
trajectory. Similarly, if the modified system encounters a block Sm+ij.+2 with more than L/2 
ones, then r2 will take the value 1 at most /i time steps later, and will stay 1 throughout 
the trajectory. Thus if the system encounters both a block with fewer than L/2 ones and a 
block with more than L/2 ones, then we will have a time to with d{t) = (0, 1) for all times 
t > tf). More precisely, let Ei be the event that there are i, i' with m + /i + 2 < i, i' < j such 
that Si{0) has fewer than L/2 ones and Si'{0) has more than L/2 ones. If an initial state 
S belongs to Ei, then Sj\f+i{t + 1) = Si{t) for all t > j. Let j be large enough so that the 
probability of Ei is at least y^. 

Moreover, let Si = {sj, . . . , sf) be listed in such an order that (t + 1) = sj^_]^(t). Let 
E2 be the event that for each k € [L] there exist j < i,i' < N + 1 with s^(0) 7^ s^, (0). 
For sufficiently large n, the probability of E2 is at least -y/p. The events Ei and E2 are 
independent, thus for sufficiently large n, a proportion of at least p of the initial states 
belong to Ei n E2. It is easy to see that none of the nodes in 5i U • • • U Sj\[+i will be 
eventually frozen for any initial state in EiD E2. Since the size of B and D* depends only 
on L, for sufficiently large n we will have > and p-fiuidity follows. 

In order to prove p-instability, we need to consider the probability space of pairs (5, k), 
where S" is a random initial state and k is the position at which the single-bit flip occurs. Let 
j, El be defined as before, let E^ be the event that the first coordinate S £ Ei, and let E^ be 
the event that the single-bit flip occurs in some block Si with i > j. If (^(O), k) £ El D E^ 
and S*{0) is the initial state obtained from S{0) by the single-bit flip at position k £ Si, 
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then \Si{{N + l)t)AS*{{N + l)t)\ = 1 for alH > 0, and Si'{{N + l)t) = S*,{{N + l)t) for all 
t >0 and i ^ i' . Thus the single-bit flip moves the system to a different basin of attraction. 
The events and £"3 are independent. For sufficiently large n we will have Pr{E^) > ^ 
and thus Pr{E\ H £'3) > p, and p-instability follows. □ 



8 Appendix E: ]3-Unstable Strictly Quadratic Systems 

Recall that a Boolean system is p-unstable if a random single-bit flip in a randomly chosen 
initial state moves the trajectory into the basin of attraction of a different attractor with 
probability at least p. Here we prove two results on such systems. 

Proposition 21 Let n be a positive integer. Then there exists a 1-unstable, strictly bi- 
quadratic cooperative Boolean system of dimension 2n. 

Proof: We construct a 2n-dimensional Boolean system {Il,g) by defining, for i G [n], the 
regulatory functions as follows: 



A ^"^^^ 
921-1 = S2i-l A S2i. 

Clearly, the resulting system is strictly bi-quadratic and cooperative. Now consider an 
initial state s(0) of the system and let i G [2n]. Note that our choice of the regulatory 
functions ensures that the number of Is in the set {s2t-i(l), S2t(l)} is the same as the 
number of Is in the set {s2j-i(0), S2i(0)}. Thus the total number of Is in s(0) is preserved 
throughout the trajectory of s(0). Since the number of Is changes if we flip a single bit, 
each one-bit flip in every initial state moves the system to a different attractor. □ 

Theorem 5 Let c he a constant such that 2\/0.75 < c < 2 and let p > 0.75 -|- ^2\nQ% • 
Then no strictly quadratic cooperative Boolean system can simultaneously he c-chaotic and 
p-unstable. 

Proof: Let c be as in the assumption and assume (11, g) is a c-chaotic strictly quadratic 
cooperative Boolean system of dimension n. A pair with j, j' G [n] will be called 

dominating if there are i, i' G [n] such that gj = SiM Si' and gj' = Sj A Sj/. Let / be the set 
of all Si with outdegree 2 that act as input of a dominating pair. 

Lemma 22 The set L has cardinality at most —^qj^- 

Proof: Let J be the union of all dominating pairs for which at least one input variable 
is in /. Note that if {k,k') are dominating pairs of variables whose input variables 

contain variables with outdegree 2, then H {k,k'} = 0. Thus |J| > |/|. Moreover, 

note that if s is a state in an attractor and is a dominating pair, then sj > Sj'] this is 

our reason for choosing the name 'dominating pair.' It follows that each orbit of the system 
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can have length at most 3l'^l/^2" '"^L Since we assumed that there exists an orbit of length 
at least c", we must have 3l-'l/22"~l'^l > c", and the lemma follows by taking logarithms. □ 



Now let Iq denote the set of i with outdegree zero, Ii the set of i with outdegree 1, 
and I2 the set of i outside of / with outdegree 2, and let />3 denote the set of odes with 
outdegree larger than 2. Since the sum of all outdegrees must equal the sum of all indegrees 
and the system was assumed to be strictly quadratic, we must have 

+ 2II2I + 2\I\ + 3|/>3| <2n = 2(|/o| + + I/2I + \I\ + \I>3\), 

and hence 

|/>3l <2|/o| + |/i|, 

which gives us 

, , 2nln(0.5c) , , 

lnU.75 

Now consider a random initial state s(0) and the state s*(0) obtained by flipping the 
value of the variable Sj(0). Clearly, if i G Iq, then s(l) = since the variable Si is not 

used at all to calculate the next state. In particular, a single-bit flip of a single variable in 
Iq will leave the system on the same trajectory with probability 1. If i G /i, then there is 
exactly one Sj for which acts as input. Assume wlog that gj = V Sj/; the case of the 
conjunction is analogous. Note that i' ^ i since the system was assumed strictly quadratic. 
With probability 0.5, we will have Sj/(0) = s*,(0) = 1. In this case the bit flip has no effect 
on the value of Sj{l) and again we get = In particular, a single-bit flip at Si for 

i £ Ii will leave the system on the same trajectory with probability at least 0.5. 

Now consider the case when i £ 12- Then there are j 7^ j' such that Si acts as input 
to both gj and gji. Then gj = SiLsi' and gj' = SiK Si", where L,K stand for the possible 
logical operators V, A. First assume i' = i" . Then we must have L = K, otherwise the pair 
(j, j') or the pair {j' ,j) would be dominating, which possibility we have excluded by making 
I2 disjoint from /. But if L = K, then the exact same argument as for i £ Ii shows that 
with probability 0.5 the bit flip at Si has no effect on the successor states Sj{l), Sji{l) and 
hence on the trajectory of s(0). 

Finally, assume i' 7^ i" and wlog that gj = Sj V Sj/ and gj^ = Si A Sin. Then with 
probability 0.25, we will have Si'(O) = 1 and Sj"(0) = 0, in which case the single-bit flip at 
Si has no effect on the successor state and = 

From the above and (1291) we conclude that 



n - 2 In 0.75 

Since the single-bit flip cannot move the system to a different basin of attraction unless 
7^ •s*(l), and the theorem follows. □ 
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9 Appendix F: Connection with Boolean Delay Systems 



One can interpret Theorem [2] in a different way. Variables witli monic regulatory functions 
in cooperative Boolean systems just record the values of other variables at some time in the 
past (less than n steps earlier). Thus if we allow time delays in the definitions of regulatory 
functions, we can remove all but the first variable on each 'tape' and define a Boolean delay 
system on the remaining variables that will have equivalent dynamics, in particular, that 
will have orbits of the same length as the original system. 

Continuous-time Boolean delay systems were studied in [HJ [12]; see jl3| for a com- 
prehensive survey and additional references. In this framework, time t takes positive real 
numbers as values, and an m-dimensional Boolean System is defined by regulatory functions 
fi : {0, 1}"" ^ {0, 1} for i G [m] such that 



Slit) = - tii),S2(i - h2), ■ ■ ■,si{t - tim)), 

S2{t) = f2{si{t - t2l),S2{t - t22), • • • , Sl{t - i2m)), 



(30) 



Sm{i) — fn{si{t — tml), S2{t — tm2), ■ ■ ■ , Si{t — tram))-, 

where the tj^'s are positive time delays. 

Now suppose (n, g) is an n-dimensional discrete Boolean system, and Sk is a variable with 
a monic regulatory function . Then either their exists a sequence of variables ki, . . . ,k£ = 
k such that gki+i = or gti^^ = -^Ski for all is — 1] and either gk^ is non-monic or 
ki = k£. The sequence ki, . . . ,k£ is uniquely determined by s^, we will call it the tape of k. 
If ki = ki, then we will say that s^ has a read-only tape. 

Now assume for simplicity of notation that the set of variables numbered si,...,Sm 
comprises all variables with non-monic regulatory functions, together with exactly one 
variable from each read-only tape. Then for each variable Sk of (11, g) with k > m 
there exists i{k) £ [m] such that for all states in any attractor of (11, /c) we either have 
Skit) = Si{A:)(i — ^(fe)) for all t or Sk{t) = -'Si(fc)(i — ^{k)). In the former case, we call Sk is 
a direct memory variable; in the latter case we call s^ an inverted memory variable. The 
number i{k) represents the length of the tape for Sk if the tape is not read-only, and has a 
similar interpretation for read-only tapes. We can also interpret i{k) as a time delay, and 
define an m-dimensional Boolean delay system (E,/) as follows: For each i S [m], let 



Mt) = 9^{sl{t - 1), ... , smit - 1), it - £(m + 1) - 1), . . . , J-(„)(t - £{n) - 1)), (31) 

where s^^^^^ = S((_£(^.)„i) if Sk is a direct memory variable and and sj^^^^ = -'S(i_£(j!(,)„i) if 
is an inverted memory variable. 
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Let L be the maximum delay in (S,/). An initial state in this system is given by 
specifying the values of Si{t) for all i G [m] and t G [0, -L). If we choose the initial state 
in such a way that all Sj(t)'s are constant on every interval [i — for I £ [L], then all 
Sj(t)'s will remain constant on intervals [i — for all positive integers i throughout the 
trajectory of this initial state. 

Now consider an initial state (ri(0), . . . , r„(0)) of (n,^), and define an initial state 
(si, ...,Srn) \ [0, L) of (S, /) so that Si(t) = ri{i - 1) whenever £ £ [L] and i - I < t < i. It 
is straightforward to verify that for all integers i > L and £ < t < £ + 1 and i £ [m] we will 
have Si{t) = ri{£). Thus the dynamics of the systems (11, and (S, /) will be equivalent 
along all orbits in an obvious sense, and we will simply write that the systems {Il,g) and 
(S, /) are equivalent. 

We get the following Corollary of Theorem [2j 

Corollary 23 For any given a,e > and positive integers b, r there exists a positive con- 
stant c < 2 such that for sufficiently large n, every c-chaotic n- dimensional e-hiased {b,r)- 
Boolean system is equivalent to a Boolean delay system with integer delays and at most an 
Boolean variables. 

Proof: Let a, e be as in the assumptions and let (11, g) be an n-dimensional e-biased (6, r)- 
Boolean system with an orbit of length at least c", where c > c(e, q/2, 6, r). By Theorem[2l 
(n,5r) is an (^n, n)-Turing system. By the argument above, there exists an equivalent 
Boolean delay system (S, /) with integer delays whose dimension m is equal to the sum of 
the number of non-monic regulatory functions in (11, g) and the number of read-only tapes 
in (n, ^). It remains to show that the latter number cannot exceed if c is sufficiently 
close to 2. 

Let us define the read-only part or strictly monic part R{g) of a Boolean system (11, g) 
as the union of all its read-only tapes. Now Corollary [23] is a consequence of the following 
observation if we let (5 = ^ . 

Lemma 24 Let 5 > and let c > 2^^^ . Then for sufficiently large n, no n-dimensional 
Boolean system (11,^) with \R{g)\ > 5n can be c-chaotic. 

Proof: First note that if T = {ki, . . . ,km} is a read-only tape of length m, then the 
dynamics of the system on T is can be described by cyclical shifts, possibly with negations in 
some positions. Thus given any initial state s(0) of the system, the vector {ski (t), . . . , Sk^ (t)) 
can take at most 2m distinct values throughout the trajectory of s(0). Since R{g) = 
{ii, . . . , £{i} is the union of pairwise disjoint read-only tapes Ti, . . . ,Ty with |Ti| -|- - • - -l-lr^l = 
|-R(g')|, it also follows from the same observation that the vector (s^^(f), . . . , S£^{t)) can take 
at most 2lcm ({|Ti|, . . . , |T„|}) distinct values throughout the trajectory of s(0), where Icm 
stand for the least common multiple. 

Let P{N) denote the maximum value of Icm ({mi, . . . , nir}) with Yll=i ~ Then 
P(N) = ev^^^^(i+°(i)) as ^ oo (see Chapter 13 of [22]). It follows that for any 
given initial state s(0), the vector of values of the variables in R{g) can take at most 
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2eVW9)\^^\Ri9m+o{i)) different values in any orbit. Thus under the assumptions of the 
lemma, the size of any orbit is bounded from above by 2^^^^')'^2e^'^^^^^^^°^^\ which is less 
than c" for c as in the assumption and sufficiently large n. □ □ 
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